-- Logs begin at Sat 2022-10-22 23:29:14 UTC, end at Sun 2022-10-23 00:38:24 UTC. -- Oct 22 23:59:33.688003 dv-cinder-861566-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 22 23:59:33.696711 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 23:59:33 2022] *** Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: nodename: dv-cinder-861566-5-iscsi Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: machine: x86_64 Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: clock source: unix Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: pcre jit disabled Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: detected number of CPU cores: 4 Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: current working directory: / Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: detected binary path: /usr/bin/uwsgi-core Oct 22 23:59:33.698687 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: your processes number limit is 47680 Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: your memory page size is 4096 bytes Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: detected max file descriptor number: 2048 Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: lock engine: pthread robust mutexes Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: thunder lock: enabled Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 22 23:59:33.699403 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 23:59:33.739163 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: Python main interpreter initialized at 0x556ecb3879c0 Oct 22 23:59:33.739163 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: python threads support enabled Oct 22 23:59:33.739163 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: your server socket listen backlog is limited to 100 connections Oct 22 23:59:33.739163 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: your mercy for graceful operations on workers is 90 seconds Oct 22 23:59:33.739528 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 23:59:33.739610 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: *** Operational MODE: preforking *** Oct 22 23:59:33.739822 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: *** uWSGI is running in multiple interpreter mode *** Oct 22 23:59:33.739822 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: spawned uWSGI master process (pid: 103859) Oct 22 23:59:33.740001 dv-cinder-861566-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 22 23:59:33.740592 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: spawned uWSGI worker 1 (pid: 103860, cores: 1) Oct 22 23:59:33.740928 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: spawned uWSGI worker 2 (pid: 103861, cores: 1) Oct 22 23:59:33.741107 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 23:59:34.403144 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 23:59:34.403877 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 23:59:35.483890 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:59:35.483890 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: from cryptography.utils import int_from_bytes Oct 22 23:59:35.484629 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:59:35.484629 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: from cryptography.utils import int_from_bytes Oct 22 23:59:35.484629 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:59:35.484629 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: from cryptography.utils import int_from_bytes Oct 22 23:59:35.485102 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:59:35.485102 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: from cryptography.utils import int_from_bytes Oct 22 23:59:37.987875 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 23:59:37.988435 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 23:59:37.988553 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 23:59:37.988553 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 23:59:37.988980 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 23:59:37.989064 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 23:59:37.989155 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 23:59:37.989236 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 23:59:37.989420 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 23:59:37.989620 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.989711 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 23:59:37.989944 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990042 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990264 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990371 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990576 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990675 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990899 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.990994 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991207 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991295 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991525 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991621 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991842 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.991949 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992152 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992243 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992409 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992540 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992736 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.992821 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993044 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993129 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-5-iscsi {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993364 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-5-iscsi {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993462 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993666 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993758 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.993967 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994052 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994270 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994368 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994569 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994653 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994865 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.994958 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.995180 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.995274 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.995480 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.995667 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996059 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996211 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996321 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996426 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996582 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996709 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.996870 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997049 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997200 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997331 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997507 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997638 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997808 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.997953 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998256 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998418 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998576 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998734 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.998866 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999037 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999256 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-5-iscsi {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999417 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-5-iscsi {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999566 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999721 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:37.999873 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000024 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000181 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000332 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000619 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000750 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.000931 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001076 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001249 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001370 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001550 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001684 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.001872 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.002002 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.002178 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.002303 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.002501 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.002697 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.003421 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.003563 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.003745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.003834 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004064 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004220 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004366 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004463 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004700 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.004790 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005003 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005089 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005318 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005412 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005619 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005706 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.005920 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006008 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006165 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006256 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006468 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006553 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.006869 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007162 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007259 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007410 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007506 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007655 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007741 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007900 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.007986 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008213 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008299 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008546 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008650 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008852 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.008938 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009155 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009252 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009452 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009536 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009754 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.009920 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010053 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010138 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010353 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010451 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010653 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010760 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.010951 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011038 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011263 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011350 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011567 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011665 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011886 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.011970 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.012188 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.012272 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.012517 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.012618 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.012912 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013000 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013160 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013253 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013462 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013560 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013792 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.013878 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014108 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014193 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014409 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014495 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014722 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.014807 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015035 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015127 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015337 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015432 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015637 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015724 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.015938 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016024 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016251 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016395 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016598 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016689 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016897 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.016986 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017143 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017253 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017439 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017544 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017734 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.017830 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018044 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018132 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018382 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018469 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018687 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018782 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.018987 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019075 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019282 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019369 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019584 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019678 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019884 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.019970 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020184 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020270 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020520 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020628 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020808 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.020898 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021114 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021214 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021414 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021510 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021717 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.021803 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022015 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022101 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022315 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022401 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022629 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022715 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.022942 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023028 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023243 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023331 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023542 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023641 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023840 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.023928 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024139 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024240 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024452 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024559 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024774 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.024862 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025076 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025208 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025390 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025482 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025688 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025773 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.025983 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026069 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026295 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026382 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026598 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026682 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026896 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.026982 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027207 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027295 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027510 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027625 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027808 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.027907 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028117 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028221 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028417 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028543 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028736 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.028830 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029034 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029140 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029328 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029428 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029624 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029730 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.029920 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030012 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030213 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030330 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030509 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030655 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030801 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.030889 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031112 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031210 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031424 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031508 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031723 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.031809 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032023 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032162 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032319 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032407 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032655 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032743 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:59:38.032983 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.033071 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.033310 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.033397 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.033648 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.033734 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034005 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034091 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034376 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034477 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034660 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034748 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.034971 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035056 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035279 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035367 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035588 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035682 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035907 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.035992 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036213 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036305 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036534 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036710 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036842 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.036982 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037156 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037261 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037465 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037574 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037793 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.037890 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038099 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038186 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038409 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038508 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038718 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.038813 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039022 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039116 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039335 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039428 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039653 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039738 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.039966 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040053 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040271 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040364 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040628 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040715 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.040969 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041054 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041274 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041371 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041592 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041678 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041902 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.041987 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042207 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042301 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042512 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042598 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042816 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.042900 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043153 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043245 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043460 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043554 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043766 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.043861 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044077 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044172 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044383 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044468 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044723 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.044832 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045030 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045117 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045332 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045464 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045638 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045735 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.045945 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046037 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046249 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046341 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046579 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046673 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.046884 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047013 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047201 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047287 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047509 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047603 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047822 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.047941 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048133 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048238 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048440 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048582 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048768 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.048864 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.049074 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.049171 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.049373 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.049972 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.050226 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.050576 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.050793 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.050894 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051183 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051287 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051483 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051580 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051797 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.051894 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052225 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052424 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052586 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052771 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.052943 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053074 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053272 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053368 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053601 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053687 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.053927 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054014 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054250 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054333 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054555 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054641 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054862 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.054970 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055159 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055255 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055479 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055566 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055783 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.055870 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056082 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056168 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056399 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056522 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056725 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.056820 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057026 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057112 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057334 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057428 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057640 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057726 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.057950 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058060 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058258 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058368 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058561 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058659 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058879 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.058976 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059185 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059291 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059517 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059613 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059838 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.059935 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060180 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060357 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060522 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060632 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060841 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.060937 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061164 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061267 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061476 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061584 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061776 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.061873 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062079 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062177 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062378 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062479 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062678 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062789 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.062977 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063077 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063367 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063580 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063667 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063879 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.063965 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064179 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064270 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064477 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064589 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064795 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.064904 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.065160 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066219 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066219 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066392 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066392 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066536 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066615 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066694 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066860 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.066956 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067166 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067279 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067514 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067599 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067824 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.067918 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068171 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068270 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068525 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068617 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068849 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.068936 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069159 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069245 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069470 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069556 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069777 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.069864 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070085 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070177 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070390 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070477 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070696 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.070782 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071009 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071315 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071398 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071630 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071716 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.071936 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072021 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072247 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072332 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072574 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072685 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072888 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.072985 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073188 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073282 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073497 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073583 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073813 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.073898 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074146 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074239 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074458 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074543 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074772 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.074857 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.075335 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.075456 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.075653 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.075752 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.075968 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076057 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076274 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076367 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076607 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076699 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076914 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.076999 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077224 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077310 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077528 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077612 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077841 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.077933 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078149 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078257 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078458 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078555 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078759 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.078862 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079073 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079171 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079371 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079469 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079680 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079777 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.079992 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.080088 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.080317 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.080420 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.080644 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.080759 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081095 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081190 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081415 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081513 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081734 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.081837 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082040 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082137 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082346 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082442 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082647 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082753 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.082947 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083044 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083250 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083346 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083558 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083663 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083862 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.083958 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084165 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084260 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084466 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084595 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084792 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.084889 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085095 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085192 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085391 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085484 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085687 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085781 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.085991 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086083 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086305 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086398 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086610 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086701 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.086925 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087025 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087242 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087351 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087542 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087628 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087839 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.087924 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088143 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088243 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088448 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088564 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088769 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.088870 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089068 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089154 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089365 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089450 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089690 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089854 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.089993 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090077 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090290 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090376 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090600 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090695 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.090918 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091004 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091223 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091308 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091531 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091625 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091836 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.091922 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092140 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092225 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092446 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092559 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092780 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.092875 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093083 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093169 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093389 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093476 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093694 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093779 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.093999 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094084 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094303 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094391 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094613 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094697 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.094915 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095006 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095222 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095316 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095533 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095633 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095833 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.095937 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.096138 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.096229 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.096449 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.096657 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.096820 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097228 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097363 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097561 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097680 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097875 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.097999 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098194 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098305 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098536 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098645 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098851 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.098952 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099180 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099268 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099507 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099594 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099817 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.099903 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100204 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100425 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100539 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100753 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.100829 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.101060 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.101137 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.103805 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.103962 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104075 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104182 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104287 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104391 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104545 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104669 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104784 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104890 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.104995 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105117 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105225 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105328 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105432 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105536 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105730 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105851 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.105957 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106061 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106263 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106373 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106477 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106590 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106704 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106810 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.106913 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107017 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107127 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107243 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107349 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107452 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107564 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107672 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107788 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107894 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.107997 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108109 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108215 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108318 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108429 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108556 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108733 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108842 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.108945 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109048 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109164 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109277 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109389 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109543 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109659 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109774 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109879 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.109982 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110571 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110656 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110746 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110827 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110906 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.110983 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111060 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111137 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111227 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111307 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111385 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111463 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111541 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111618 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111708 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111788 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.111872 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.112529 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.112715 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.112883 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.112984 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113272 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113368 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113581 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113669 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113888 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.113976 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114190 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114276 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114491 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114575 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114790 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.114875 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115096 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115187 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115398 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115482 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115716 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115853 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.115997 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116082 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116297 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116419 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116633 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116734 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.116937 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117024 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117239 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117334 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117536 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117621 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117841 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.117933 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118143 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118236 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118440 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118525 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.118864 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119069 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119178 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119367 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119463 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119666 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119753 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.119971 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120064 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120269 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120353 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120590 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120694 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120898 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.120992 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121217 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121304 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121521 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121605 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121826 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.121911 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122129 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122215 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122429 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122514 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122728 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.122814 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123027 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123153 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123329 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123416 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123629 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123715 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.123925 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124009 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124224 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124317 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124541 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124628 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124842 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.124927 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125159 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125262 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125462 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125547 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125758 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.125849 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126056 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126158 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126421 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126521 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126690 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126775 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.126988 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.127082 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.127342 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.127427 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.128325 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.128799 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.128960 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129050 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129130 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129215 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129295 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129380 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129522 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129610 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129831 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.129922 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130133 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130257 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130445 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130531 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130750 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.130842 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131057 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131149 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131357 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131442 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131673 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131759 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.131987 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132071 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132301 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132388 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132648 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132750 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.132977 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133076 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133303 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133388 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133609 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133707 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.133908 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134001 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134214 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134300 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134522 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134607 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134829 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.134929 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135137 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135222 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135444 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135530 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135751 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.135845 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136061 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136156 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136369 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136477 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136702 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.136790 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137012 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137123 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137315 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137406 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137622 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137707 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.137925 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138011 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138227 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138313 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138541 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138626 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138844 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.138935 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139146 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139234 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139448 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139532 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139746 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.139831 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140048 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140140 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140346 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140516 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140800 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.140889 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141113 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141209 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141418 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141503 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141720 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.141804 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142031 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142124 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142338 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142424 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142650 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142735 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.142955 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.143117 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.143285 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.143877 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.143995 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144082 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144222 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144347 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144439 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144553 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144781 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.144870 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145089 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145183 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145389 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145474 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145697 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.145783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146002 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146087 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146304 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146398 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146604 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146734 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146902 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.146999 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147215 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147299 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147513 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147606 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147830 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.147941 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148243 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148329 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148571 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148677 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148871 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.148988 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149280 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149366 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149588 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149682 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149895 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.149998 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150212 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150298 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150529 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150623 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150834 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.150928 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151137 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151221 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151446 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151531 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151748 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.151841 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152068 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152154 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152377 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152521 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152704 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.152798 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153015 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153101 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153313 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153399 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153630 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153731 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.153948 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154033 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154257 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154341 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154574 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154661 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.154981 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155074 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155290 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155374 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155592 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155677 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155908 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.155993 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156218 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156310 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156539 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156640 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156842 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.156937 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157143 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157237 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157438 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157522 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157735 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.157821 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158050 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158142 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158350 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158436 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158655 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.158747 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159252 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159369 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159460 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159548 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159629 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159708 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159868 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.159956 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160185 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160279 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160538 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160626 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160858 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.160947 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161183 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161276 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161505 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161591 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161811 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.161898 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162116 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162201 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162428 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162513 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162730 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.162817 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163028 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163122 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163326 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163420 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163623 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163710 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.163958 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164056 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164256 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164355 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164601 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164714 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.164938 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.165250 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.166953 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167072 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167148 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167148 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167271 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167339 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167339 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167473 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167544 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167612 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167687 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167756 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167832 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167923 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.167993 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168155 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168286 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168472 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168618 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168814 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.168924 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169118 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169234 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169420 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169540 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169727 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.169843 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170027 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170145 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170327 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170471 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170626 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170776 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.170929 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171099 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171229 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171408 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171528 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171711 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.171826 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172014 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172144 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172317 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172448 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172684 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172773 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.172989 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173088 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173320 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173406 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173631 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173718 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.173929 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.174026 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.174258 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.174343 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175091 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175538 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175635 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175717 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175795 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.175875 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176001 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176122 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176312 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176440 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176645 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176807 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.176962 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177119 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177270 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177437 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177580 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177755 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.177888 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178075 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178196 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178499 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178612 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178808 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.178944 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179260 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179429 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179573 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179887 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.179972 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180203 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180290 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180540 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180647 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180857 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.180953 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181178 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181273 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181483 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181575 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181791 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.181893 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182095 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182188 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182401 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182502 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182706 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.182814 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183018 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183123 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183341 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183436 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183656 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183844 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.183976 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184068 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184290 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184376 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184629 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184718 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.184941 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185027 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185251 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185340 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185559 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185646 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185882 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.185967 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186201 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186296 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186500 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186585 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186808 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.186908 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187280 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187425 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187513 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187731 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.187824 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188036 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188131 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188345 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188432 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188778 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.188981 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189069 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189284 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189373 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189591 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189757 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189896 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.189984 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.190286 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.190797 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.190891 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.190980 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191070 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191185 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191271 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191491 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191580 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191801 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.191889 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192181 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192313 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192529 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192648 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192851 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.192974 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193172 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193294 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193505 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193613 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193822 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.193958 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194122 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194210 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194434 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194521 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194744 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.194831 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195049 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195142 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195370 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195473 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195673 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195761 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.195972 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196058 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196289 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196383 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196616 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196706 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.196916 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.197154 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.197286 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.197508 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.197615 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.197830 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198036 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198159 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198383 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198485 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198698 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.198797 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199023 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199130 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199348 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199446 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199761 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.199967 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.200323 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.200576 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.200685 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.200885 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.200981 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201189 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201288 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201491 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201587 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201793 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.201898 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202092 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202200 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202391 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202489 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202697 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202793 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.202998 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203104 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203297 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203404 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203600 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203706 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.203897 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204018 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204201 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204291 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204511 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204605 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204822 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.204929 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.205121 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.205233 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.205422 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.205514 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.206235 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.206487 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.206742 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.206853 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.206941 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207022 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207217 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207360 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207512 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207655 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207814 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.207937 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208118 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208293 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208417 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208646 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208736 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.208958 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209080 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209287 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209383 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209596 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209683 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.209904 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210004 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210223 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210311 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210535 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210631 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210840 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.210928 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211144 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211238 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211462 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211550 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211769 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.211858 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212074 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212169 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212413 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212653 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212758 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.212991 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213267 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213355 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213597 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213816 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213909 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.213990 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214228 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214329 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214546 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214643 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.214944 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215151 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215239 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215451 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215557 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215769 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.215857 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216073 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216166 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216379 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216475 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216708 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.216797 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217013 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217101 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217318 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217455 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217652 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.217927 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218016 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218230 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218327 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218534 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218622 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218836 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.218924 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219138 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219228 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219439 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219527 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219740 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.219836 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220043 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220131 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220352 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220440 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220711 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.220818 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.221025 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.221119 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.221962 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222067 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222241 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222339 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222556 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222870 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.222959 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223181 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223269 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223486 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223574 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223790 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.223878 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.224100 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.224206 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.224407 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.224516 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.224745 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.225046 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.225143 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.225431 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.225714 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.225802 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226029 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226126 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226347 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226435 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226666 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226755 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.226975 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227074 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227289 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227377 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227605 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227691 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.227915 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228010 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228228 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228315 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228568 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228662 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228908 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.228998 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229234 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229320 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229543 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229631 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229850 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.229938 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230154 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230240 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230456 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230548 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230756 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.230856 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231061 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231157 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231366 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231459 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231668 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231755 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.231968 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232056 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232266 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232363 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232593 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232683 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232892 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.232988 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233189 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233286 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233487 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233582 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233786 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.233881 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234086 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234183 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234382 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234471 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234678 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234766 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.234975 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235076 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235273 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235368 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235569 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235657 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235868 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.235956 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236169 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236262 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236463 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236588 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236782 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.236872 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237107 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237200 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237471 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237573 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.237850 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238126 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238219 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238405 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238504 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238710 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.238798 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239025 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239119 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239329 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239426 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239645 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239734 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.239949 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240036 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240264 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240364 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240597 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240688 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240907 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.240993 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241213 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241313 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241523 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241609 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241828 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.241915 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242133 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242237 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242439 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242525 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242747 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.242834 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243048 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243137 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243350 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243445 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243673 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243761 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.243996 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244084 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244297 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244390 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244635 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244726 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.244949 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245039 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245260 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245360 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245591 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245691 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245902 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.245989 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246215 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246302 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246526 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246622 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246829 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.246926 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247134 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247228 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247440 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247536 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247745 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.247846 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248053 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248147 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248359 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248453 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248686 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248775 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.248997 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249085 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249307 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249396 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249627 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249713 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.249945 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250031 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250250 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250348 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250572 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250671 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.250893 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251025 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251233 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251321 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251544 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251637 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251868 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.251962 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.252182 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.252270 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.252570 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.252667 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.252839 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.253042 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 23:59:38.253135 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:59:38.253357 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 23:59:38.406465 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Registered counter for database nova_api Oct 22 23:59:38.407300 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO dbcounter [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Registered counter for database nova_api Oct 22 23:59:38.429022 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.430717 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.435750 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.437115 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writer thread running {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.493858 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.context [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06(cell1) {{(pid=103861) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 23:59:38.494238 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.context [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06(cell1) {{(pid=103860) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 23:59:38.497664 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 23:59:38.498046 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 23:59:38.498152 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 23:59:38.498508 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 23:59:38.499699 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 23:59:38.500065 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 23:59:38.500402 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 23:59:38.500785 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 23:59:38.500888 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 23:59:38.501218 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 23:59:38.503477 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 23:59:38.503700 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 23:59:38.505560 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Registered counter for database nova_cell0 Oct 22 23:59:38.505693 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO dbcounter [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Registered counter for database nova_cell0 Oct 22 23:59:38.509689 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO dbcounter [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Registered counter for database nova_cell1 Oct 22 23:59:38.509955 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Registered counter for database nova_cell1 Oct 22 23:59:38.516955 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.521606 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.521751 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.524599 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writer thread running {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.525419 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.527853 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.661353 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writer thread running {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.666135 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.671276 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO dbcounter [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Registered counter for database nova_cell0 Oct 22 23:59:38.675217 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Registered counter for database nova_cell0 Oct 22 23:59:38.680025 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.683845 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:59:38.684714 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writer thread running {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:38.688522 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:59:39.023869 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 23:59:39.027059 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: WARNING keystonemiddleware.auth_token [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 23:59:39.031112 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 23:59:39.034359 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: WARNING keystonemiddleware.auth_token [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 23:59:39.379046 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: WARNING keystonemiddleware.auth_token [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 23:59:39.379250 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 23:59:39.385069 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: WARNING keystonemiddleware.auth_token [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 23:59:39.385203 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 23:59:39.390320 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ecb3879c0 pid: 103861 (default app) Oct 22 23:59:39.390423 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ecb3879c0 pid: 103860 (default app) Oct 22 23:59:39.392388 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 23:59:39.394342 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-e8278f01-0110-4896-ac6c-7a9e9428e237 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001854 Oct 22 23:59:39.394755 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sat Oct 22 23:59:39 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:00.622196 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:00.623431 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Oct 23 00:01:00.623828 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:00.640048 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:00.641167 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell0:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:00.641992 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell1:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:00.643157 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:01.520325 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-d6077b89-9cf1-49a7-a8bb-fffd927fb299 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:01.553793 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-d6077b89-9cf1-49a7-a8bb-fffd927fb299 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923700 Oct 23 00:01:01.554776 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 00:01:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:04.179285 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:04.180330 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-2ea6c72e-2f81-4405-b52a-8e931670dd9a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 23 00:01:04.185590 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:04.632312 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-30a20b80-2f32-4693-9913-23173eeac831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "name": "cirros256"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:04.681653 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-30a20b80-2f32-4693-9913-23173eeac831 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494773 Oct 23 00:01:04.682273 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:04.696474 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_api:SELECT=3 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:04.697658 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_cell0:SELECT=3 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:04.699712 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_cell1:SELECT=3 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:04.700461 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:04.908429 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-1e9e01ac-472c-440a-9832-e9b59b85347d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:04.979364 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-1e9e01ac-472c-440a-9832-e9b59b85347d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288812 Oct 23 00:01:04.979981 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 00:01:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:07.599770 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-30a20b80-2f32-4693-9913-23173eeac831 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:07.600843 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-30a20b80-2f32-4693-9913-23173eeac831 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 23 00:01:07.601696 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:08.270421 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-b25067a5-c86f-48d6-864f-142db8e7b032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "name": "ds512M"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:08.310522 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-b25067a5-c86f-48d6-864f-142db8e7b032 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702700 Oct 23 00:01:08.311426 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:08.323889 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-7e7f9588-a155-4654-86eb-554ee12b2fa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:08.370713 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-7e7f9588-a155-4654-86eb-554ee12b2fa0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050393 Oct 23 00:01:08.372636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 00:01:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:10.991284 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-b25067a5-c86f-48d6-864f-142db8e7b032 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:10.992350 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-b25067a5-c86f-48d6-864f-142db8e7b032 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 23 00:01:10.993088 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:11.405161 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-aac9c7b2-bc05-40de-88e4-ac3c1bec3897 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:11.425618 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-aac9c7b2-bc05-40de-88e4-ac3c1bec3897 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425823 Oct 23 00:01:11.426321 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:11.438209 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-a340433a-31f6-410a-b052-48853e87cfdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:11.468992 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-a340433a-31f6-410a-b052-48853e87cfdb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034407 Oct 23 00:01:11.469558 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 00:01:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:14.094160 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-aac9c7b2-bc05-40de-88e4-ac3c1bec3897 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:14.095177 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-aac9c7b2-bc05-40de-88e4-ac3c1bec3897 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 23 00:01:14.095830 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:14.515800 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-e7a02230-e984-4079-a926-0672967e802b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "name": "ds2G"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:14.535531 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-e7a02230-e984-4079-a926-0672967e802b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432372 Oct 23 00:01:14.536432 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:14.548754 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-23daf3a0-74a9-42a2-bb63-204e5d917cee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:14.578676 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-23daf3a0-74a9-42a2-bb63-204e5d917cee admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033619 Oct 23 00:01:14.580446 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 00:01:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:17.283189 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-e7a02230-e984-4079-a926-0672967e802b admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:17.285753 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-e7a02230-e984-4079-a926-0672967e802b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Oct 23 00:01:17.286235 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:17.729350 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "swap": 0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:17.750290 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456706 Oct 23 00:01:17.750928 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:17.766382 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-d124d600-bae9-494b-bc92-b5ad78a3c721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:17.798725 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-d124d600-bae9-494b-bc92-b5ad78a3c721 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037055 Oct 23 00:01:17.799741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 00:01:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:20.587087 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:20.588109 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 23 00:01:20.588546 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:21.022566 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-91e0f005-9aa0-40d7-8ce0-242e04366fbd admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:21.048077 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-91e0f005-9aa0-40d7-8ce0-242e04366fbd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453128 Oct 23 00:01:21.048705 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 00:01:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:23.723814 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:23.724869 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0c3fb41d-e195-4262-81ea-110b42127c40 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 23 00:01:23.725298 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:01:24.121724 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-621b8471-96f5-405d-a745-348127722bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:24.141338 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-621b8471-96f5-405d-a745-348127722bf7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409765 Oct 23 00:01:24.141878 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:24.154262 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-ae1769d1-0bff-440e-a75a-dfd92ffa7859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:24.181914 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-ae1769d1-0bff-440e-a75a-dfd92ffa7859 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031407 Oct 23 00:01:24.182494 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 00:01:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:26.789527 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-621b8471-96f5-405d-a745-348127722bf7 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:26.790455 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-621b8471-96f5-405d-a745-348127722bf7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 23 00:01:26.791363 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:27.213005 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0ee0fb6e-cc65-4836-b1f1-87aee409ff43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "vcpus": 1, "name": "m1.small", "disk": 20, "ram": 2048}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:27.239212 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0ee0fb6e-cc65-4836-b1f1-87aee409ff43 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.441533 Oct 23 00:01:27.239768 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:27.251961 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-c5b9ab0f-f045-41d8-abc4-c34a6fd610b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:27.279866 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-c5b9ab0f-f045-41d8-abc4-c34a6fd610b1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031620 Oct 23 00:01:27.281421 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 00:01:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:01:29.976469 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0ee0fb6e-cc65-4836-b1f1-87aee409ff43 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:29.977524 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0ee0fb6e-cc65-4836-b1f1-87aee409ff43 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 23 00:01:29.977935 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:30.432843 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-9fc9b0a6-dbe3-4e23-8aa9-3e068ef366a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:30.458792 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-9fc9b0a6-dbe3-4e23-8aa9-3e068ef366a1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474674 Oct 23 00:01:30.460519 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:01:30.471406 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-eaeee29b-f079-415a-a139-96e14baf8501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:30.500256 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-eaeee29b-f079-415a-a139-96e14baf8501 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032375 Oct 23 00:01:30.504788 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 00:01:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:33.173694 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-9fc9b0a6-dbe3-4e23-8aa9-3e068ef366a1 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:33.176070 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-9fc9b0a6-dbe3-4e23-8aa9-3e068ef366a1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002752 Oct 23 00:01:33.176567 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:33.651745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-9954614c-2b0e-4673-a50b-a01bb0ddfa20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:33.657302 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:33.672064 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-9954614c-2b0e-4673-a50b-a01bb0ddfa20 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488976 Oct 23 00:01:33.672961 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:01:33.685863 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-0a9f5bfd-5938-4851-8655-3104db20590e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:33.716238 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-0a9f5bfd-5938-4851-8655-3104db20590e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034045 Oct 23 00:01:33.716851 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 00:01:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:36.392283 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-9954614c-2b0e-4673-a50b-a01bb0ddfa20 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:36.394466 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-9954614c-2b0e-4673-a50b-a01bb0ddfa20 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002594 Oct 23 00:01:36.394988 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:36.843777 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:36.850996 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:36.866219 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464468 Oct 23 00:01:36.866782 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 00:01:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:01:36.879007 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-660ea4c9-4bf5-4837-a9c8-499345d520b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:01:36.907010 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-660ea4c9-4bf5-4837-a9c8-499345d520b6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031595 Oct 23 00:01:36.924514 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 00:01:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:01:53.472432 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:53.473548 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 23 00:01:53.473946 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:53.484328 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:53.864228 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-ff75885d-5a1d-4eaa-bc86-d22e4f31d4d9 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:53.882643 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-ff75885d-5a1d-4eaa-bc86-d22e4f31d4d9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402797 Oct 23 00:01:53.883179 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 00:01:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:55.187728 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:55.188809 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-40106ee2-da99-47c2-84a6-e680a0615262 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 23 00:01:55.189199 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:55.705120 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-c63f4512-2c5e-4b6e-ab18-22b9ccf194f7 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:55.710428 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-c63f4512-2c5e-4b6e-ab18-22b9ccf194f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-c63f4512-2c5e-4b6e-ab18-22b9ccf194f7 admin admin] Request method failure captured: Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept: application/json Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Connection: keep-alive Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Content-Length: 0 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Host: 10.222.0.13 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABjVIRzCbPkKaIyTISH3WUYZzoX8ZeTIkXG2xpJb_y2TeCjdYX7UskryRq3vd8BarQvKhWbP7QBpVdsZhwIgLeBEQZY088nDop1YLliYiZrWPo7t7eng3mqe-3SuR-ZiyUMVFLZ8QBby8OPX7YQP9dtmKno3IwVJlp0xR5Cca0kHl2B62M Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Id: None Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Name: None Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Name: admin Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Role: admin,member,reader Oct 23 00:01:55.713636 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Roles: admin,member,reader Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant: admin Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User: admin Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Name: admin Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: method: > Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: exception: Flavor 42 could not be found. Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: action_args: {'id': '42'} Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:55.715114 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:55.716059 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.717748 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-c63f4512-2c5e-4b6e-ab18-22b9ccf194f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:55.719135 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-c63f4512-2c5e-4b6e-ab18-22b9ccf194f7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390297 Oct 23 00:01:55.719135 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 00:01:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:55.725414 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-58bbe57a-31e5-4ffa-b97a-912d5b9a41fa admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:55.749662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-58bbe57a-31e5-4ffa-b97a-912d5b9a41fa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028569 Oct 23 00:01:55.750204 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:55.761108 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-82459e70-d5fa-4705-9aa0-486fe46385c3 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:55.782796 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-82459e70-d5fa-4705-9aa0-486fe46385c3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026120 Oct 23 00:01:55.783256 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:55.793632 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2414d187-c760-4fdf-9ba2-071e21c9347d admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:55.798807 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.wsgi [None req-2414d187-c760-4fdf-9ba2-071e21c9347d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2414d187-c760-4fdf-9ba2-071e21c9347d admin admin] Request method failure captured: Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept: application/json Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept-Encoding: gzip, deflate Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Connection: keep-alive Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Content-Length: 0 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Host: 10.222.0.13 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-System-Scope: None Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: User-Agent: python-novaclient Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Auth-Token: gAAAAABjVIRzCbPkKaIyTISH3WUYZzoX8ZeTIkXG2xpJb_y2TeCjdYX7UskryRq3vd8BarQvKhWbP7QBpVdsZhwIgLeBEQZY088nDop1YLliYiZrWPo7t7eng3mqe-3SuR-ZiyUMVFLZ8QBby8OPX7YQP9dtmKno3IwVJlp0xR5Cca0kHl2B62M Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Id: None Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Name: None Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Identity-Status: Confirmed Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Is-Admin-Project: True Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Id: default Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Name: Default Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Name: admin Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Role: admin,member,reader Oct 23 00:01:55.802157 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Roles: admin,member,reader Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant: admin Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Name: admin Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User: admin Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Id: default Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Name: Default Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Name: admin Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: method: > Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: exception: Flavor 42 could not be found. Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: action_args: {'id': '42'} Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:55.803662 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:55.804646 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:55.805787 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2414d187-c760-4fdf-9ba2-071e21c9347d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:55.806800 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-2414d187-c760-4fdf-9ba2-071e21c9347d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013931 Oct 23 00:01:55.806800 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 00:01:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:57.011921 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-82459e70-d5fa-4705-9aa0-486fe46385c3 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:57.012980 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-82459e70-d5fa-4705-9aa0-486fe46385c3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 23 00:01:57.013376 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:57.531004 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-241f0b5e-877f-41d3-8088-8a0d3594c598 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:57.536863 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.wsgi [None req-241f0b5e-877f-41d3-8088-8a0d3594c598 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-241f0b5e-877f-41d3-8088-8a0d3594c598 admin admin] Request method failure captured: Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept: application/json Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept-Encoding: gzip, deflate Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Connection: keep-alive Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Content-Length: 0 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Host: 10.222.0.13 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-System-Scope: None Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: User-Agent: python-novaclient Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Auth-Token: gAAAAABjVIR0f78pN3hUI5BPiwGy6tLxsymWNZSpgOF0G8eDn-zEKQR-JgNixrRAn2j382ruCso4ZVD8yUzlR2YaDwjtQWZ-0Tg4qNjdLsrsuEzm6N8Q4OUf8kYo5BZ_fvcXNPpZsfEqOgNzoR8Ctl4JDfM2CN_FbMPZ3XmHU07rpDlxL-Y0edM Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Id: None Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Name: None Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Identity-Status: Confirmed Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Is-Admin-Project: True Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Id: default Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Name: Default Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Name: admin Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Role: admin,member,reader Oct 23 00:01:57.538384 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Roles: admin,member,reader Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant: admin Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Name: admin Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User: admin Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Id: default Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Name: Default Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Name: admin Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: method: > Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: exception: Flavor 84 could not be found. Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: action_args: {'id': '84'} Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:57.539850 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:57.540676 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.541859 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-241f0b5e-877f-41d3-8088-8a0d3594c598 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:57.542878 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-241f0b5e-877f-41d3-8088-8a0d3594c598 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389632 Oct 23 00:01:57.542878 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 00:01:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:57.549338 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-24f385bf-4b94-494f-b688-1667c6828fb1 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:57.563990 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-24f385bf-4b94-494f-b688-1667c6828fb1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018222 Oct 23 00:01:57.564532 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:57.573960 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2fda051f-b512-48d3-975f-877e3f8d84bc admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:57.589921 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-2fda051f-b512-48d3-975f-877e3f8d84bc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019516 Oct 23 00:01:57.590436 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:01:57.600213 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0a665c47-3015-423a-804a-c3ceb43d0d17 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:57.605148 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-0a665c47-3015-423a-804a-c3ceb43d0d17 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0a665c47-3015-423a-804a-c3ceb43d0d17 admin admin] Request method failure captured: Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept: application/json Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Connection: keep-alive Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Content-Length: 0 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Host: 10.222.0.13 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABjVIR0f78pN3hUI5BPiwGy6tLxsymWNZSpgOF0G8eDn-zEKQR-JgNixrRAn2j382ruCso4ZVD8yUzlR2YaDwjtQWZ-0Tg4qNjdLsrsuEzm6N8Q4OUf8kYo5BZ_fvcXNPpZsfEqOgNzoR8Ctl4JDfM2CN_FbMPZ3XmHU07rpDlxL-Y0edM Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Id: None Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Name: None Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Name: admin Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Role: admin,member,reader Oct 23 00:01:57.606630 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Roles: admin,member,reader Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant: admin Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User: admin Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Name: admin Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: method: > Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: exception: Flavor 84 could not be found. Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: action_args: {'id': '84'} Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:57.607896 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:57.608745 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:57.609906 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-0a665c47-3015-423a-804a-c3ceb43d0d17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:57.610934 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-0a665c47-3015-423a-804a-c3ceb43d0d17 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011882 Oct 23 00:01:57.610934 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 00:01:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:58.812200 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-2fda051f-b512-48d3-975f-877e3f8d84bc admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:58.813233 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-2fda051f-b512-48d3-975f-877e3f8d84bc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 23 00:01:58.813618 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:01:59.329183 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e687c17d-424e-459b-8125-1814e606ab78 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:59.335282 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-e687c17d-424e-459b-8125-1814e606ab78 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e687c17d-424e-459b-8125-1814e606ab78 admin admin] Request method failure captured: Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept: application/json Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Connection: keep-alive Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Content-Length: 0 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Host: 10.222.0.13 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABjVIR2LREUGnPWdrOYdJATv_lklHTHxc9QcXb0H32IXE_wvPFlYTpcW51e7KMpmfHx2WBCOePzadpaAiIvEjEpTjUeqokInEanBhc4dEneyYO6lf_8dKbKY0ep0eCUDjDHQilKUUSMCTlPfo0BdtXkIEyFk1fFwiM0jnVW1pWvde5WwME Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Id: None Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Domain-Name: None Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Project-Name: admin Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Role: admin,member,reader Oct 23 00:01:59.336783 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Roles: admin,member,reader Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant: admin Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User: admin Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: X-User-Name: admin Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: method: > Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: exception: Flavor 451 could not be found. Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: action_args: {'id': '451'} Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:59.338261 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:59.339384 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.340792 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e687c17d-424e-459b-8125-1814e606ab78 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:59.342108 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-e687c17d-424e-459b-8125-1814e606ab78 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388509 Oct 23 00:01:59.342108 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:01:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:59.348721 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-932a59ee-f889-43bb-9a47-0095bb2c2a44 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:59.363961 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-932a59ee-f889-43bb-9a47-0095bb2c2a44 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019818 Oct 23 00:01:59.364481 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:01:59.373479 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:59.388032 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017994 Oct 23 00:01:59.388562 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 00:01:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:01:59.397727 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-7978fd34-db29-4f34-bd29-d3bdb2dfbfca admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:01:59.402606 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.wsgi [None req-7978fd34-db29-4f34-bd29-d3bdb2dfbfca admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-7978fd34-db29-4f34-bd29-d3bdb2dfbfca admin admin] Request method failure captured: Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept: application/json Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Accept-Encoding: gzip, deflate Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Connection: keep-alive Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Content-Length: 0 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Host: 10.222.0.13 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-Api-Version: compute 2.92 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Openstack-System-Scope: None Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: User-Agent: python-novaclient Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Auth-Token: gAAAAABjVIR2LREUGnPWdrOYdJATv_lklHTHxc9QcXb0H32IXE_wvPFlYTpcW51e7KMpmfHx2WBCOePzadpaAiIvEjEpTjUeqokInEanBhc4dEneyYO6lf_8dKbKY0ep0eCUDjDHQilKUUSMCTlPfo0BdtXkIEyFk1fFwiM0jnVW1pWvde5WwME Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Id: None Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Domain-Name: None Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Identity-Status: Confirmed Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Is-Admin-Project: True Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Id: default Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Domain-Name: Default Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Project-Name: admin Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Role: admin,member,reader Oct 23 00:01:59.404093 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Roles: admin,member,reader Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e646fb7093394a37b996a9f2520c5910", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e646fb7093394a37b996a9f2520c5910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant: admin Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Id: e646fb7093394a37b996a9f2520c5910 Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-Tenant-Name: admin Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User: admin Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Id: default Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Domain-Name: Default Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Id: ac8d80b2c4a24dfea25c6de809bc37e3 Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: X-User-Name: admin Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: method: > Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: exception: Flavor 451 could not be found. Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: action_args: {'id': '451'} Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:01:59.405761 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:59.406603 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: ERROR nova.api.openstack.wsgi Oct 23 00:01:59.407741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-7978fd34-db29-4f34-bd29-d3bdb2dfbfca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:01:59.408777 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-7978fd34-db29-4f34-bd29-d3bdb2dfbfca admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011391 Oct 23 00:01:59.408777 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:01:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:00.620291 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:00.621319 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 23 00:02:00.621707 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:02:01.146688 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-327666c2-2b36-475a-a855-bd5970cbc92c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:02:01.165699 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-327666c2-2b36-475a-a855-bd5970cbc92c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404438 Oct 23 00:02:01.166233 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 00:02:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:02:02.373112 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:02.374141 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 23 00:02:02.374530 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:02:02.899297 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-1bd4a9b8-5555-4651-ada8-f78a6be78d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:02:02.918282 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-1bd4a9b8-5555-4651-ada8-f78a6be78d81 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396928 Oct 23 00:02:02.918816 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 00:02:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:02:04.129940 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:04.130967 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 23 00:02:04.131361 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:02:04.657895 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-d1969502-0363-42c5-a924-d2c538932fe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:02:04.676571 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-d1969502-0363-42c5-a924-d2c538932fe7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406600 Oct 23 00:02:04.677106 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 00:02:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:02:05.877759 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:05.879334 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Oct 23 00:02:05.879729 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:02:06.401860 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-63bab5e7-484e-466e-b3de-51ffee04f953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:02:06.420291 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-63bab5e7-484e-466e-b3de-51ffee04f953 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405551 Oct 23 00:02:06.421134 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 00:02:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:02:07.631050 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:07.632048 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 23 00:02:07.632467 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:02:08.163255 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-f60d7ee1-203b-4cf4-9e52-c9d2b60951c3 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:02:08.183726 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-f60d7ee1-203b-4cf4-9e52-c9d2b60951c3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411476 Oct 23 00:02:08.184329 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Oct 23 00:02:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:03:05.017153 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.018163 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-be07e523-885f-45c0-a4d2-ca54ac7d360f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 23 00:03:05.018558 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:03:05.029055 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:05.416057 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-fa5f0be8-1de3-4f80-af15-c89fe771c425 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.436582 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-fa5f0be8-1de3-4f80-af15-c89fe771c425 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411936 Oct 23 00:03:05.437108 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:03:05.458974 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=14 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:05.462865 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f84c3927-d7a4-43ed-9e12-7334fbc6aa6f admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.470199 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-f84c3927-d7a4-43ed-9e12-7334fbc6aa6f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012753 Oct 23 00:03:05.470716 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:03:05.482790 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-47b0ec0a-6ed2-49d5-a46c-3d63c6a9b898 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.490608 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-47b0ec0a-6ed2-49d5-a46c-3d63c6a9b898 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011409 Oct 23 00:03:05.491121 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:03:05.502393 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.509641 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010723 Oct 23 00:03:05.510146 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:03:05.521265 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-f9aebeb3-6eca-4fe2-8d38-00347705118a admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:03:05.528409 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-f9aebeb3-6eca-4fe2-8d38-00347705118a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010657 Oct 23 00:03:05.528950 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 23 00:03:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:05:56.291056 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:05:56.292131 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 23 00:05:56.292554 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:05:56.436862 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_api:SELECT=6 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:05:56.596526 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:05:56.601201 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:05:56.601674 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:05:56.602097 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:05:56.602806 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:05:56.603249 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:05:56.603667 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:05:56.635281 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-e8452f05-5e49-4951-a89f-72589547e105 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199656 Oct 23 00:05:56.635849 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:05:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:05:57.722988 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:05:57.724000 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 23 00:05:57.724393 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:05:57.915169 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:05:57.919097 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:05:57.919562 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:05:57.920012 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:05:57.920741 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:05:57.921180 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:05:57.921589 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:05:57.941255 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-fd5993c1-0fb6-429e-af98-1778ebd74091 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077429 Oct 23 00:05:57.941734 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:05:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:06:09.404890 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:06:09.405897 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Oct 23 00:06:09.406286 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:06:09.551537 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_cell0:SELECT=4 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:09.552277 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_cell1:SELECT=4 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:09.553094 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG dbcounter [-] [103860] Writing DB stats nova_api:SELECT=8 {{(pid=103860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:09.600973 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:06:09.604401 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:06:09.605027 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:06:09.605463 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:06:09.606180 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:06:09.606627 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:06:09.607048 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:06:09.632537 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-0d04c9d5-7739-4f65-bff3-13e01a4d13b5 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085266 Oct 23 00:06:09.633025 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:06:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:06:10.725203 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:06:10.726202 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a05fa428-f7df-4049-bb2e-544e56dfc354 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 23 00:06:10.726593 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 00:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:06:10.917115 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG nova.api.openstack.wsgi [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Calling method '>' {{(pid=103860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:06:10.920480 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:06:10.920974 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:06:10.921394 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:06:10.922126 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:06:10.922562 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:06:10.922972 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: DEBUG oslo_concurrency.lockutils [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:06:10.944534 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: INFO nova.api.openstack.requestlog [None req-90a0052f-377f-44ed-8d3a-1023c06d4e07 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079793 Oct 23 00:06:10.944999 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: [pid: 103860|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 00:06:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:07:06.086777 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: Sun Oct 23 00:07:06 2022 - graceful shutdown triggered... Oct 23 00:07:06.087020 dv-cinder-861566-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 23 00:07:06.087680 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: Gracefully killing worker 2 (pid: 103861)... Oct 23 00:07:06.088144 dv-cinder-861566-5-iscsi devstack@n-api.service[103860]: Gracefully killing worker 1 (pid: 103860)... Oct 23 00:07:06.215226 dv-cinder-861566-5-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=4 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:07.087921 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: worker 1 buried after 1 seconds Oct 23 00:07:07.088464 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: worker 2 buried after 1 seconds Oct 23 00:07:07.088464 dv-cinder-861566-5-iscsi devstack@n-api.service[103859]: goodbye to uWSGI. Oct 23 00:07:07.089729 dv-cinder-861566-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 23 00:07:07.090281 dv-cinder-861566-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 23 00:07:07.093204 dv-cinder-861566-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 00:07:07.104945 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 00:07:07 2022] *** Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: nodename: dv-cinder-861566-5-iscsi Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: machine: x86_64 Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: clock source: unix Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: pcre jit disabled Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: detected number of CPU cores: 4 Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: current working directory: / Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: detected binary path: /usr/bin/uwsgi-core Oct 23 00:07:07.106918 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: your processes number limit is 47680 Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: your memory page size is 4096 bytes Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: detected max file descriptor number: 2048 Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: lock engine: pthread robust mutexes Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: thunder lock: enabled Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 00:07:07.107634 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 00:07:07.150085 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: Python main interpreter initialized at 0x560a776119c0 Oct 23 00:07:07.150085 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: python threads support enabled Oct 23 00:07:07.150085 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: your server socket listen backlog is limited to 100 connections Oct 23 00:07:07.150085 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: your mercy for graceful operations on workers is 90 seconds Oct 23 00:07:07.150513 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 00:07:07.150513 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: *** Operational MODE: preforking *** Oct 23 00:07:07.150794 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: *** uWSGI is running in multiple interpreter mode *** Oct 23 00:07:07.150794 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: spawned uWSGI master process (pid: 118834) Oct 23 00:07:07.151004 dv-cinder-861566-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 23 00:07:07.151995 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: spawned uWSGI worker 1 (pid: 118854, cores: 1) Oct 23 00:07:07.152524 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: spawned uWSGI worker 2 (pid: 118855, cores: 1) Oct 23 00:07:07.168876 dv-cinder-861566-5-iscsi devstack@n-api.service[118834]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 00:07:07.817895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 00:07:07.818647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 00:07:09.076843 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:07:09.076843 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: from cryptography.utils import int_from_bytes Oct 23 00:07:09.078084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:07:09.078084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: from cryptography.utils import int_from_bytes Oct 23 00:07:09.078776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:07:09.078776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: from cryptography.utils import int_from_bytes Oct 23 00:07:09.079224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:07:09.079224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: from cryptography.utils import int_from_bytes Oct 23 00:07:11.546486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:07:11.547142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:07:11.547232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:07:11.547549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:07:11.547818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:07:11.548224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.548586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.548924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.549256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.549599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.549925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.550261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.550584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.550926 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.551195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.551526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.551862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-5-iscsi {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.552212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.552680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.553021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.553352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.553671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.554005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.554321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.554833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.556831 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.557398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.557990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.558603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.559168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.559723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.560316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.560848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.561855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.562157 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.562983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-5-iscsi {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.562983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.563283 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.563588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.564074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.564406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.564773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.565111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.565462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.565787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.566128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.566465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.566888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.567226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.567545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.567873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.568198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.568551 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.568886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.569194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.569452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.569771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.570102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.570438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.570773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.571035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.571293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.571627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.571960 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.572278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.572647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.572959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.573465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.573941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.574421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.574909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.575393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.575559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:07:11.576014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:07:11.576479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.576680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:07:11.577253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.577768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.577982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:07:11.578341 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:07:11.578592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.579138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.579325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.579650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.580080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.580206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.580612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.580827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.581220 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.581456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.581718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.582150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.582274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.582751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.583098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.583409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.583614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.584072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.584198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.584620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.584866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.585134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-5-iscsi {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.585504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.585616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.586033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.586248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.586531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.586895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.587015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.587418 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.587665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.587928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.588342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.588456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.589058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.589613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.589902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.590127 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.590546 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.590656 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.591116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.591239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.591640 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.591865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.592154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.593050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.593375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.593893 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.594374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.594488 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.595168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.595302 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.595559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.596049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.596544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.597035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.597370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.597683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.597932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.598323 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.598568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-5-iscsi {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.598958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.599081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.599526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.599695 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.600051 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.600312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.600710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.600974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.601242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.601625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.601737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.602165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.602374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.602698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.603018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.603206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.603640 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.603753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.604153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.604362 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.604713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.605013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.605234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.605653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.605827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.606305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.606788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.606899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.607310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.607525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.607834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.608202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.608933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.609321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.609694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.609960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.610343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.610457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.610900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.611055 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.611431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.611686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.611964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.612334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.612452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.612815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.613101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.613343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.613743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.613868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.614289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.614521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.614808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.615154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.615316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.615745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.615938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.616277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.616578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.616874 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.617215 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.617381 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.617810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.617989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.618333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.618607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.618858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.619225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.619354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.619783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.619964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.620322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.620624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.620967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.621293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.621414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.621818 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.622032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.622382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.622671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.622905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.623301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.623423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.623929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.624101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.624652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.626245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.626747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.627198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.627642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.627919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.628187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.628686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.629120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.629341 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.629597 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.630026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.630461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.630619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.630992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.631427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.631696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.631947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.632378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.632823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.632975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.633337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.633771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.634084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.634299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.634728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.635154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.635333 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.635673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.636000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.636179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.636637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.637069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.637216 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.637439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.637634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.637796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.637893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.638143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.638275 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.638488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.638839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.639186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.639426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.639624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.639905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.640244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.640599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.640711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.640946 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.641289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.641637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.641889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.641993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.642294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.642652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.642984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.643089 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.643340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.643682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.644025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.644305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.644419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.644783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.645117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.645424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.645556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.645798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.646129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.646464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.646713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.646815 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.647115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.647442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.647773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.648030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.648140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.648408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.649250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.649250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.649400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.649739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.650072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.650311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.650420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.650721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.651050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.651378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.651653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.651764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.652015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.652340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.652755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.653066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.653178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.653426 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.653766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.654110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.654361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.654480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.654773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.655629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.655957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.656214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.656316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.656717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.657041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.657360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.657471 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.657686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.658008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.658352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.658639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.658741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.658983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.659322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.659643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.659904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.660015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.660279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.660627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.660952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.661235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.661346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.661585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.661924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.662250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.662507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.662622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.662910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.663253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.663574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.663792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.663892 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.664232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.664587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.664923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.665230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.665686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.666011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.666297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.666399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.666634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.666953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.667270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.667585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.667714 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.667936 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.668066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.668280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.668667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.668784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.668977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.669104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.669308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.669629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.669729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.669948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.670054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.670266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.670396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.670623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.671611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.671829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.672378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.672378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.672581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.672655 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:07:11.672742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673300 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.673948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.674286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.674454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.674605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.674752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.674900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.675994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.676984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.677140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.677296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.677451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.677616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.677842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678491 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.678955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679109 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.679983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680740 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.680922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.681880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682194 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.682851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.683970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.684098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.684395 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.684574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.684752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.684884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685399 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.685857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.686053 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.686184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.686499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.686846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.686984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.687166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.687487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.687750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.687873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.688298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.688664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.688854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.689011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.689313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.689709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.690050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.692298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.692463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.692700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.692874 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.693786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.694221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.694221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.694221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.695853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.695853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.695853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.695853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.696438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.696623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.696775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.696932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.697851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.698930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.699863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.700869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.701978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.702132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.702842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703640 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.703790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704094 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.704933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.705090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.705239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.705395 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.705550 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.705865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706492 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706651 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.706964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.707261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.707419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.707568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.707725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.707875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708702 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.708878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709655 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.709975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710290 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.710917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711226 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.711952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.712104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.712253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.712408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.712677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.712851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.713933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.714084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.714233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.714634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.714786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.714944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.715111 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.715268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.715419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.715576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.715733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.716996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.717153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.717314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.717463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.718431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.718963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.719907 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.720855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.721938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722474 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.722940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723089 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.723887 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.724958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.725901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.726965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727576 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727724 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.727889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728194 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.728847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729662 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.729967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730272 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.730856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.731972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732265 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732405 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.732885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.733026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.733194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.734404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.734547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.734698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.734840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.734933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.735989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.736346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.736518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.736667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.736667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.736956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737394 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.737997 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.738899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739181 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.739900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740039 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740471 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.740993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741544 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741907 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.741996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.742924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.743982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.744143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.744256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.744357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.744603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.744716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.745971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.746163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.746705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.746838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.746957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747757 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.747935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.748018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.748101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.749962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750751 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.750937 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751105 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751288 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751288 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751458 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.751997 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.752727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.753009 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.753309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.753660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.753986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.754963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755506 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.755972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.756183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.756277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.756561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.756781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.756953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.757992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.758196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.758351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.758538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.758729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.758884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.759999 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.760961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.761887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762036 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.762861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.763923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.764115 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.764288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.764476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.765324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.765523 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.765698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.765851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.766871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.767028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.767199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.767357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.767506 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.768657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.768835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769002 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.769924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770244 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.770878 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771638 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.771952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.772119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.772269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.772425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.772782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773220 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.773865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.774859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775318 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775631 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.775932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.776996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777472 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.777936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.778995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.779891 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.780609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.781326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.781508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.781676 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.781838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.781989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.782966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783124 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.783912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.784930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.785871 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.786996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.787223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.787386 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.787537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.787696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.787854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.788852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.789788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.790234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.790397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.790549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.790698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.790848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791323 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.791952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.792908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.793840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.794956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.795114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.795265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.795414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.795562 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.796307 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.796978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.797168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.797424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.797588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.797747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.797899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798381 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.798987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.799967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800590 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.800908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.801850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.802933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.803880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.804898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.805992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.806935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.807106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.807265 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.807432 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.807657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.807880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808218 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.808860 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.809953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.810971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.811122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.811294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.811888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812596 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.812927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.813870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.814182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.814381 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.814589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.814750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.814939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.815935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.816967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.817120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.817306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.817467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.817634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.817879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.818983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819185 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819495 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.819985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.820250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.820456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.820642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.820794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.820954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.821902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.822071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.822411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.822570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.822751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.822904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.823969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.824132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.824292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.824443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.824700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.824866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825798 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.825946 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.826104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.826264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.826414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.826564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.826712 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.827391 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.827664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.827901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.828130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.828285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.828442 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.828692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.828854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.829944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.830995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.831295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.831446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.831619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.831779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.831929 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.832871 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.833020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.833186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.833690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.833864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.834849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.835941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.836925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.837841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.838877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.839036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.839195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.839351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.839764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.839921 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840094 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840762 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.840942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841656 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.841932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.842880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.843930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844567 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.844972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.845959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846772 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846772 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.846933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.847948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.848107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.848278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.848539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.848700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.848851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.849938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.850089 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.850259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.850437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.850696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.850852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.851947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852426 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.852945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.853236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.853395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.853546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.853709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.853861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.854909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.855993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.856151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.856310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.856468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.856710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.856864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857021 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.857815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.858106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.859238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.859416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.859582 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.859741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.859892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.860923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861552 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.861866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.862957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.863998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.864984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.865140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.865299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.865457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.865681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.865860 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.866955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867105 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867405 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:07:11.867734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.867734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.868161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.868309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.868778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.868961 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.869190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.869500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.869850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.870186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.870492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.870978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.871155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.871437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.871759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.872070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.872382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.872742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.873103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.873463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.873818 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.874564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.874846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.875186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.875522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.875848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.876185 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.876543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.876865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.877193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.877615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.877958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.878307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.878641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.878971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.879281 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.879594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.879911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.880232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.880582 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.880908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.881225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.881542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.881861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.882175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.882490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.882801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.883109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.883422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.883738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.884052 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.884364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.884706 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.885012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.885332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.885658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.885959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.886274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.886574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.886879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.887186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.887664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.887967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.888289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.889031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.889353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.890557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.891082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.891426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.891764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.892099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.892416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.892802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.893120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.893448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.893772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.894086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.894401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.894717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.895050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.895386 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.895716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.896044 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.896368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.896758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.897199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.897404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.897998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.898487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.898814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.899142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.899480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.899785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.900113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.900428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.900771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.901092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.901411 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.901744 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.903753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.904228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.904379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.904829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.905043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.905917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:07:11.906132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:07:11.931495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO dbcounter [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Registered counter for database nova_api Oct 23 00:07:11.952427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_db.sqlalchemy.engines [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:11.959432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writer thread running {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:11.969869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO dbcounter [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Registered counter for database nova_api Oct 23 00:07:11.989589 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_db.sqlalchemy.engines [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:11.996152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writer thread running {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.017424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.context [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06(cell1) {{(pid=118855) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 00:07:12.021588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:07:12.022076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:07:12.023703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:07:12.024447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:07:12.024929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:07:12.026945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:07:12.028986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO dbcounter [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Registered counter for database nova_cell0 Oct 23 00:07:12.033881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO dbcounter [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Registered counter for database nova_cell1 Oct 23 00:07:12.041300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_db.sqlalchemy.engines [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.043922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_db.sqlalchemy.engines [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.047606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writer thread running {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.060642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.context [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06(cell1) {{(pid=118854) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 00:07:12.065324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:07:12.065863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:07:12.067508 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:07:12.068302 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:07:12.068796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:07:12.070825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:07:12.072922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO dbcounter [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Registered counter for database nova_cell0 Oct 23 00:07:12.077931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO dbcounter [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Registered counter for database nova_cell1 Oct 23 00:07:12.085684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_db.sqlalchemy.engines [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.088690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_db.sqlalchemy.engines [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.096873 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writer thread running {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.098966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writer thread running {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.190509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writer thread running {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.199401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO dbcounter [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Registered counter for database nova_cell0 Oct 23 00:07:12.207970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_db.sqlalchemy.engines [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.212985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writer thread running {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.246991 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO dbcounter [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Registered counter for database nova_cell0 Oct 23 00:07:12.254524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_db.sqlalchemy.engines [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:07:12.259260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writer thread running {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:07:12.534388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: WARNING keystonemiddleware.auth_token [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:07:12.542260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: WARNING keystonemiddleware.auth_token [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:07:12.580465 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: WARNING keystonemiddleware.auth_token [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:07:12.588296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: WARNING keystonemiddleware.auth_token [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:07:12.890259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: WARNING keystonemiddleware.auth_token [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:07:12.896401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: WARNING keystonemiddleware.auth_token [None req-59be7eaf-aa61-4c4d-bd8a-ed23522abbbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:07:12.901751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560a776119c0 pid: 118855 (default app) Oct 23 00:07:12.930945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: WARNING keystonemiddleware.auth_token [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:07:12.937050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: WARNING keystonemiddleware.auth_token [None req-a06e757c-48bd-4d59-8e65-06c4adc39a34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:07:12.942481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560a776119c0 pid: 118854 (default app) Oct 23 00:07:49.555452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:49.557156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:49.557834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:49.558575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:51.069926 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-510cac57-3932-4e55-89a7-5550c7e59ae1 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Action: 'create', calling method: .version_select at 0x7f3f8e7f3ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1395023809"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:07:51.952870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:51.954464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:51.956779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:51.962318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:52.328311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-18eb9c5f-faf4-4e96-941a-c4674f4633b5 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8e7d9ca0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:52.489887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-510cac57-3932-4e55-89a7-5550c7e59ae1 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.942715 Oct 23 00:07:52.491579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Oct 23 00:07:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2947 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 00:07:52.506542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8acc9a05-4efd-403b-888d-20fe44e434e8 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e679d30>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:52.626543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8acc9a05-4efd-403b-888d-20fe44e434e8 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 200 len: 345 microversion: 2.1 time: 0.123759 Oct 23 00:07:52.627252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:07:52 2022] GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:07:52.801318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-18eb9c5f-faf4-4e96-941a-c4674f4633b5 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0e25e2c9-6612-4b98-b4f7-50150577b232" status: 200 len: 351 microversion: 2.1 time: 0.854218 Oct 23 00:07:52.801918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 1/3] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:07:51 2022] GET /compute/v2.1/os-volumes/0e25e2c9-6612-4b98-b4f7-50150577b232 => generated 351 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:53.656535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2ffb8e1b-a23b-4cd1-8c91-422b8d0b1be9 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60d430>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:53.946072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2ffb8e1b-a23b-4cd1-8c91-422b8d0b1be9 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 200 len: 346 microversion: 2.1 time: 0.308625 Oct 23 00:07:53.946699 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:07:53 2022] GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 346 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:53.972344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5fb78405-6176-43ea-ba51-f4e5d42c5955 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Action: 'create', calling method: .version_select at 0x7f3f8e6b2d30>, body: {"snapshot": {"volume_id": "8ca17869-802e-44ae-b08e-05069df77b99", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-983633343"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:07:54.339853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5fb78405-6176-43ea-ba51-f4e5d42c5955 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.382082 Oct 23 00:07:54.342564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 2/5] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 23 00:07:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:54.355001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-918bad7b-ad8b-46f7-a961-4978708160ad tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60daf0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:54.461174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-918bad7b-ad8b-46f7-a961-4978708160ad tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.110019 Oct 23 00:07:54.465277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:54 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:54.479616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-182b88f9-2fcf-4409-939d-6ded9cdfcce4 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e674c10>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:54.489691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-167a612a-d9c4-4c90-93ec-8b06eaea1215 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8e679ca0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:54.555718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-182b88f9-2fcf-4409-939d-6ded9cdfcce4 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.082539 Oct 23 00:07:54.556286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 23 00:07:54 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:54.569426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9105c006-efef-4e81-8351-d340837f48e8 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e611040>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:54.606658 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-167a612a-d9c4-4c90-93ec-8b06eaea1215 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/a9e4f8dd-3c83-4c3e-b00d-d82d139bf2f9" status: 200 len: 351 microversion: 2.1 time: 0.124578 Oct 23 00:07:54.613173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:07:54 2022] GET /compute/v2.1/os-volumes/a9e4f8dd-3c83-4c3e-b00d-d82d139bf2f9 => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:54.630121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9105c006-efef-4e81-8351-d340837f48e8 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.064653 Oct 23 00:07:54.631026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 4/9] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:54 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:55.643425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a4bf02f1-aedd-45d0-a80f-491eb95d04a4 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60d8b0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:55.715691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a4bf02f1-aedd-45d0-a80f-491eb95d04a4 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.075598 Oct 23 00:07:55.717382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:55 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:56.732005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8c760b99-dd87-45de-8a30-b4f58a2b18d9 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e608af0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:56.799537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8c760b99-dd87-45de-8a30-b4f58a2b18d9 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.073574 Oct 23 00:07:56.800566 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:56 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:57.821330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d28af6f3-fd24-45d1-b878-e61618df6c20 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60d1f0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:57.876636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d28af6f3-fd24-45d1-b878-e61618df6c20 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.065665 Oct 23 00:07:57.877651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:57 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:07:58.890047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43370288-a373-4699-b9b1-b91584cfcbda tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e608430>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:07:59.014521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-43370288-a373-4699-b9b1-b91584cfcbda tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.128385 Oct 23 00:07:59.015459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:07:58 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:00.027414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-33b18227-c85b-4e57-80e9-43244c62d5a0 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60d160>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:00.099664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-33b18227-c85b-4e57-80e9-43244c62d5a0 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.076065 Oct 23 00:08:00.100543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:00 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:01.113336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-64c8b5f4-2f74-4680-9db4-135c05f64e5a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e674af0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:01.184709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-64c8b5f4-2f74-4680-9db4-135c05f64e5a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 287 microversion: 2.1 time: 0.076020 Oct 23 00:08:01.185284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:01 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:01.197723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6fadd5b3-9f0f-4f41-8257-f58a3cefab4f tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e60d820>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:01.427657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6fadd5b3-9f0f-4f41-8257-f58a3cefab4f tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 202 len: 0 microversion: 2.1 time: 0.234081 Oct 23 00:08:01.428513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 23 00:08:01 2022] DELETE /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:08:01.437766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6575501d-2ebe-4e2a-9f03-1481ba48af88 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e6b2ee0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:01.522967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6575501d-2ebe-4e2a-9f03-1481ba48af88 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.089887 Oct 23 00:08:01.524921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:01 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:02.542782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f2872e18-6f18-481a-a1a1-eaf52f41ac7d tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e856ca0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:02.607047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f2872e18-6f18-481a-a1a1-eaf52f41ac7d tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.072817 Oct 23 00:08:02.607863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 9/18] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:02 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:03.317604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1a5444f3-bff8-48e3-997f-227717936440 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: .version_select at 0x7f3f8e679ca0>, body: {"keypair": {"name": "tempest-keypair-147605134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUtZLrdOY9JZVtTYSrL8wc1Ekmp43zcv6nAf9bIFsy1MrT2hHjy/Jw8CmDNKUcfYY6RuYa/VYEHmVPwictPcGZDAVvrxo7JPx9kvUjAnL9JG+z7ImKsIFLnAWFsexjjYQ=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:03.433870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-1a5444f3-bff8-48e3-997f-227717936440 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for project 55445c398b424025b2588386af037755. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:08:03.442048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-1a5444f3-bff8-48e3-997f-227717936440 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for user 8b4ef165353f4f1189400c005519c2ac and project 55445c398b424025b2588386af037755. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:08:03.543999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1a5444f3-bff8-48e3-997f-227717936440 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.078914 Oct 23 00:08:03.544987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 10/19] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 23 00:08:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1080 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 00:08:03.621675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c337359f-8b98-43f6-9570-2d6e204721d3 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e608040>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:03.676813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c337359f-8b98-43f6-9570-2d6e204721d3 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 200 len: 286 microversion: 2.1 time: 0.058849 Oct 23 00:08:03.684544 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 10/20] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:03 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:04.701597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-42616961", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "networks": [{"uuid": "9b98cc2d-57bf-4330-b313-765e7e15151b"}]}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:04.925554 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] validate_networks() for [('9b98cc2d-57bf-4330-b313-765e7e15151b', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:08:04.998222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2030312512", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:05.161052 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] validate_networks() for [('e3cf21a0-16e9-4515-9796-e9995b9dcdd3', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:08:07.428108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:08:07.428665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:08:07.429021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:08:07.430584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:08:07.431163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:08:07.439647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:08:07.440208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:08:07.440789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:08:07.441278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:08:07.441801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:08:07.456845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:07.457398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:07.457846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:07.458641 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:07.459328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:07.460001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:07.471851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:07.472606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:07.473200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:07.478836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:07.479697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:07.480449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:07.520966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:08:07.532359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for user f95f4fc0d5c5428c96545f543139489b and project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:08:07.542950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Getting quotas for project 06566ec2efab47ea80f2f10723b478a5. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:08:07.554988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Getting quotas for user 127eff42dfb141c3b78ce04636af1f28 and project 06566ec2efab47ea80f2f10723b478a5. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:08:07.556732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:08:07.559909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:08:07.600737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:08:07.607936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:08:07.683377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ee0fb44a-7727-4365-ac7d-a1e486e7cb0a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.139333 Oct 23 00:08:07.686047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 11/21] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:08:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 00:08:07.700473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-210d52b9-59bf-4557-8d2e-0f840fd90452 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8dd0aa60>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:07.749925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-210d52b9-59bf-4557-8d2e-0f840fd90452 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] HTTP exception thrown: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-210d52b9-59bf-4557-8d2e-0f840fd90452 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Request method failure captured: Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 HTTP/1.1 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXVh8Cxarnc_pHUcncWWCRf8V0amKitSbXkAbYAlGdfYu2v3moJx84oYen2UbwVYmOMU8YONFYTkmja5ZCoJldHfSfrEmA9kgei2bJpW1Po532wtFHdUUcxwAdC6P1Qg5sfUPvWxgCdXLa18RU-sSmadu2djsleiFVm63VZwQKP_2c Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:08:07.755163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6d730bc61aaa4ef88dc3961fe3f498e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 40e1a487cab9418480172aa1f32d7caf Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '5dec9603-21c3-472c-befc-6560001947f3'} Oct 23 00:08:07.756604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. (HTTP 404) (Request-ID: req-f497a26b-a44b-4ff6-bcdd-950427b4be7f) Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.757452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:07.758505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 23 00:08:07.759588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. Oct 23 00:08:07.760836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:07.762787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-210d52b9-59bf-4557-8d2e-0f840fd90452 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Returning 404 to user: Snapshot 5dec9603-21c3-472c-befc-6560001947f3 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:08:07.764047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-210d52b9-59bf-4557-8d2e-0f840fd90452 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3" status: 404 len: 111 microversion: 2.1 time: 0.076716 Oct 23 00:08:07.768290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3834ad85-4481-4681-b1aa-cad2f870b429 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.403955 Oct 23 00:08:07.770529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 00:08:07 2022] GET /compute/v2.1/os-snapshots/5dec9603-21c3-472c-befc-6560001947f3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:07.771035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 11/23] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 00:08:07.786016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dc1df9cf-75bb-4bf3-a994-109b587aac1e tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dcd9ee0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:07.799599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-970247628", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f2fafb2-ad48-465f-83e8-e4588186756a"}], "security_groups": [{"name": "tempest-securitygroup--612253448"}], "key_name": "tempest-keypair-147605134", "user_data": "}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:08.084448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dc1df9cf-75bb-4bf3-a994-109b587aac1e tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9db14aa2-e1b5-49f2-ac68-8a10d566630e" status: 200 len: 350 microversion: 2.1 time: 0.312638 Oct 23 00:08:08.085235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:07 2022] GET /compute/v2.1/os-volumes/9db14aa2-e1b5-49f2-ac68-8a10d566630e => generated 350 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:08.100888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-627ba3d2-1a62-4272-bb92-46c34176e67c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:08.101489 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-627ba3d2-1a62-4272-bb92-46c34176e67c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:08.140627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] validate_networks() for [('8f2fafb2-ad48-465f-83e8-e4588186756a', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:08:08.593500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-627ba3d2-1a62-4272-bb92-46c34176e67c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:08.636798 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-627ba3d2-1a62-4272-bb92-46c34176e67c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1222 microversion: 2.1 time: 0.544521 Oct 23 00:08:08.649721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:08 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1222 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:08.672443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-698abcd4-bd79-4c95-aded-3f39149aefa0 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8dcd9dc0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:08.780812 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-698abcd4-bd79-4c95-aded-3f39149aefa0 tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 202 len: 0 microversion: 2.1 time: 0.128274 Oct 23 00:08:08.783534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 15/26] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:08:08 2022] DELETE /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:08:08.795556 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-51193a3e-b9e3-4e95-ab6f-8df68754bbe0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:08.799570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-51193a3e-b9e3-4e95-ab6f-8df68754bbe0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:09.066361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-51193a3e-b9e3-4e95-ab6f-8df68754bbe0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:09.075887 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-51193a3e-b9e3-4e95-ab6f-8df68754bbe0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1213 microversion: 2.1 time: 0.291036 Oct 23 00:08:09.094662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 16/27] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:08 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1213 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:09.123274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-93dbab0e-7005-4956-88e6-48b188fdbd68 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dca7550>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:09.350431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-93dbab0e-7005-4956-88e6-48b188fdbd68 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.254403 Oct 23 00:08:09.351461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 17/28] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 23 00:08:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:09.365931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-69dbb79f-1179-4144-923f-d6f791aaac6c tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8dcb4790>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:09.439849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-69dbb79f-1179-4144-923f-d6f791aaac6c tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] HTTP exception thrown: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-69dbb79f-1179-4144-923f-d6f791aaac6c tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Request method failure captured: Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 HTTP/1.1 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXVh8Cxarnc_pHUcncWWCRf8V0amKitSbXkAbYAlGdfYu2v3moJx84oYen2UbwVYmOMU8YONFYTkmja5ZCoJldHfSfrEmA9kgei2bJpW1Po532wtFHdUUcxwAdC6P1Qg5sfUPvWxgCdXLa18RU-sSmadu2djsleiFVm63VZwQKP_2c Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:08:09.442973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6d730bc61aaa4ef88dc3961fe3f498e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 40e1a487cab9418480172aa1f32d7caf Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '8ca17869-802e-44ae-b08e-05069df77b99'} Oct 23 00:08:09.444253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. (HTTP 404) (Request-ID: req-9501a887-e2f8-4b59-a3dd-32ba8baf6882) Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:09.445098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:09.446248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 00:08:09.447325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:09.448403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:08:09.449536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-69dbb79f-1179-4144-923f-d6f791aaac6c tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Returning 404 to user: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:08:09.450627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-69dbb79f-1179-4144-923f-d6f791aaac6c tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 404 len: 109 microversion: 2.1 time: 0.098016 Oct 23 00:08:09.451274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 18/29] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:09 2022] GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:09.472171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-807757075", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:09.511298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:08:09.512383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:08:09.513355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:08:09.514133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:08:09.515382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:08:09.566196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:09.569346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:09.570093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:09.571132 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:09.573925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:09.575431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:09.610055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] validate_networks() for [('e3cf21a0-16e9-4515-9796-e9995b9dcdd3', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:08:09.676309 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for project 55445c398b424025b2588386af037755. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:08:09.695525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for user 8b4ef165353f4f1189400c005519c2ac and project 55445c398b424025b2588386af037755. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:08:09.731094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:08:09.741396 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:08:09.862532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9de7fb40-4213-4e69-9c02-d6b49d4ac3d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.088556 Oct 23 00:08:09.865218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 12/30] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 23 00:08:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 00:08:09.885403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4a7093cb-b768-4058-9cac-378be0a5bc69 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8e4d9310>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:10.174968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4a7093cb-b768-4058-9cac-378be0a5bc69 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.302081 Oct 23 00:08:10.189520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 13/31] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 23 00:08:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:10.195798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c05f7209-c967-44fb-a971-af442182a4ba tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8e4f7280>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:10.281995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-c05f7209-c967-44fb-a971-af442182a4ba tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] HTTP exception thrown: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c05f7209-c967-44fb-a971-af442182a4ba tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Request method failure captured: Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 HTTP/1.1 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXVh8Cxarnc_pHUcncWWCRf8V0amKitSbXkAbYAlGdfYu2v3moJx84oYen2UbwVYmOMU8YONFYTkmja5ZCoJldHfSfrEmA9kgei2bJpW1Po532wtFHdUUcxwAdC6P1Qg5sfUPvWxgCdXLa18RU-sSmadu2djsleiFVm63VZwQKP_2c Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:08:10.288777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6d730bc61aaa4ef88dc3961fe3f498e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 40e1a487cab9418480172aa1f32d7caf Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '8ca17869-802e-44ae-b08e-05069df77b99'} Oct 23 00:08:10.290457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. (HTTP 404) (Request-ID: req-4a8f0e38-a3f8-4599-a0a2-6bd9e46f2044) Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:10.291150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:08:10.292289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 00:08:10.293234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:10.299100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:10.302573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c05f7209-c967-44fb-a971-af442182a4ba tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Returning 404 to user: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:08:10.304052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c05f7209-c967-44fb-a971-af442182a4ba tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 404 len: 109 microversion: 2.1 time: 0.112915 Oct 23 00:08:10.305766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 14/32] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:08:10 2022] DELETE /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:10.313657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:10.320771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:10.510952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:10.558333 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:10.566535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:10.571618 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8eb0353a-3e83-4a5b-b88e-5758ea783de9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1280 microversion: 2.20 time: 0.260901 Oct 23 00:08:10.598523 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:10 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:10.618891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:10.619914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:10.646880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:10.647674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:10.651285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:10.652425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:10.653390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:10.655245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:10.803604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:08:10.804190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:08:10.804819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:08:10.805706 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:08:10.805953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:08:10.832519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:10.834160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:10.834614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:10.850749 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:10.852663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:10.855025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:10.918862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:08:10.926046 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for user f95f4fc0d5c5428c96545f543139489b and project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:08:10.946037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:08:10.955147 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:08:11.137499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c270906a-1a3b-4747-9298-14e270294937 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.678890 Oct 23 00:08:11.144384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 19/34] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:08:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:08:11.173859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3ffa42e5-511c-4a65-a917-62f745c15b5a tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dca74c0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.181105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:11.219520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-15b2432b-04bb-4a92-bc37-3e9c17ca5cac tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1209 microversion: 2.1 time: 0.617537 Oct 23 00:08:11.240127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 16/35] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:10 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1209 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:11.260072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d9be862-66a5-444f-a142-9401b8c03a6a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Calling method '.version_select at 0x7f3f8dbe1ee0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.338437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-2d9be862-66a5-444f-a142-9401b8c03a6a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] HTTP exception thrown: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d9be862-66a5-444f-a142-9401b8c03a6a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Request method failure captured: Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 HTTP/1.1 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXVh8Cxarnc_pHUcncWWCRf8V0amKitSbXkAbYAlGdfYu2v3moJx84oYen2UbwVYmOMU8YONFYTkmja5ZCoJldHfSfrEmA9kgei2bJpW1Po532wtFHdUUcxwAdC6P1Qg5sfUPvWxgCdXLa18RU-sSmadu2djsleiFVm63VZwQKP_2c Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:08:11.341543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6d730bc61aaa4ef88dc3961fe3f498e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d730bc61aaa4ef88dc3961fe3f498e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 6d730bc61aaa4ef88dc3961fe3f498e8 Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237844659 Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 40e1a487cab9418480172aa1f32d7caf Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237844659-project Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '8ca17869-802e-44ae-b08e-05069df77b99'} Oct 23 00:08:11.342835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. (HTTP 404) (Request-ID: req-b939faa5-554c-4980-afd2-6b180d43dafa) Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:11.343688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:11.344705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 00:08:11.345888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:11.347403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d9be862-66a5-444f-a142-9401b8c03a6a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] Returning 404 to user: Volume 8ca17869-802e-44ae-b08e-05069df77b99 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:08:11.348795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2d9be862-66a5-444f-a142-9401b8c03a6a tempest-VolumesSnapshotsTestJSON-1237844659 tempest-VolumesSnapshotsTestJSON-1237844659-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99" status: 404 len: 109 microversion: 2.1 time: 0.101619 Oct 23 00:08:11.353807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 17/36] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/os-volumes/8ca17869-802e-44ae-b08e-05069df77b99 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:11.361018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d4fd279b-7618-4d91-b8b7-3a26b8210644 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.361805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d4fd279b-7618-4d91-b8b7-3a26b8210644 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:11.409481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3ffa42e5-511c-4a65-a917-62f745c15b5a tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.263356 Oct 23 00:08:11.410065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 20/37] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:11.426700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f33c3e27-7510-4805-a939-1b185612f302 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dcd9f70>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.517684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d4fd279b-7618-4d91-b8b7-3a26b8210644 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:11.528396 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d4fd279b-7618-4d91-b8b7-3a26b8210644 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1221 microversion: 2.1 time: 0.171924 Oct 23 00:08:11.546795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:11.608673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.609266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:11.644235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:11.647595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:11.650081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:11.653475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:11.656800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:11.662945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:11.691895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f33c3e27-7510-4805-a939-1b185612f302 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.269095 Oct 23 00:08:11.692541 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:08:11.707209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4fb10a2e-1917-4da8-9bd6-4c0517b0a7da tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dc49a60>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:11.832857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:11.866328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:11.871183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:11.896515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-18836891-a79c-4709-b16a-28eaae1b8f55 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1276 microversion: 2.20 time: 0.288406 Oct 23 00:08:11.897210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 19/40] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:12.160757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4fb10a2e-1917-4da8-9bd6-4c0517b0a7da tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.457596 Oct 23 00:08:12.179945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 22/41] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 23 00:08:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:08:12.188884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b195513f-6675-400c-97f6-4ac0c22d27e1 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dbe1280>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:12.267629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:12.268698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:12.283814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:12.287132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:12.289826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:12.291405 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:12.293245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:12.293959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:12.513811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b195513f-6675-400c-97f6-4ac0c22d27e1 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.329932 Oct 23 00:08:12.515407 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 20/42] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 23 00:08:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:12.531526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f639ca33-2d33-4273-b857-c83e09bda34f tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8db9bdc0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:12.714269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:12.741647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f639ca33-2d33-4273-b857-c83e09bda34f tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.214843 Oct 23 00:08:12.742495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 23 00:08:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:08:12.742619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-03f3dee1-b2f6-4359-b1e4-1e887039ab44 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1265 microversion: 2.1 time: 0.469637 Oct 23 00:08:12.743274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 23/44] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:12 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1265 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:12.747739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:12.748567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:12.763045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:12.764199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:12.765558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-41e01f1d-8056-4c33-a966-bcbd6e64bda7 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] Calling method '.version_select at 0x7f3f8dc3af70>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:12.768637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:12.770035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:12.770749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:12.771414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:13.098793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-41e01f1d-8056-4c33-a966-bcbd6e64bda7 tempest-VolumesTestJSON-1411781234 tempest-VolumesTestJSON-1411781234-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.344191 Oct 23 00:08:13.099583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 24/45] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 23 00:08:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:13.117904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:13.121080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:13.141616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:13.142886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:13.144471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:13.150001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:13.152373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:13.161012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:13.596636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:13.610096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-78a4096c-7f37-4256-82d8-6b435b9322e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1225 microversion: 2.1 time: 0.866198 Oct 23 00:08:13.611024 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 22/46] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:12 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1225 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:13.776698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:13.778890 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:13.793488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:13.799553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:13.803506 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:13.804588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:13.805586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:13.809194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:13.851458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:13.863217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:13.867227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:13.868379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9e47c6c4-f90c-4fd6-8359-39d31882d63e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1332 microversion: 2.20 time: 0.767661 Oct 23 00:08:13.880324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 25/47] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:13 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1332 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:14.104751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:14.159229 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-412dfea8-fc31-4a97-81e4-7139db8a566f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1271 microversion: 2.1 time: 0.387699 Oct 23 00:08:14.191481 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:13 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1271 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:14.634910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:14.635600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:14.654099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:14.664366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:14.669577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:14.675322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:14.675925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:14.676390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:14.912516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:14.913743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:14.926313 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:14.927054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:14.927687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:14.928604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:14.929484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:14.930082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:15.359530 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:15.389909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:15.413785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-583ed57a-af50-4a7a-b372-c3005b2cd8b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1273 microversion: 2.1 time: 0.780074 Oct 23 00:08:15.414408 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 26/49] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:14 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1273 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:15.436063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:15.449633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:15.450829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-590c3f8d-b0e3-4291-aa1b-f09d5ccc6108 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1338 microversion: 2.20 time: 0.542211 Oct 23 00:08:15.455895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 24/50] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:14 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1338 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:15.459193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:15.465359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:15.504504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:15.508475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:15.509886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:15.512217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:15.520233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:15.521084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:15.741847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:15.782083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2e5d085b-2e51-49b1-bf56-58ddbb70d073 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1271 microversion: 2.1 time: 0.349111 Oct 23 00:08:15.786286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 27/51] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:15 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:16.443531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:16.445373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:16.461425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:16.461934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:16.464352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:16.469608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:16.473305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:16.473921 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:16.495890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:16.500452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:16.514203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:16.515496 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:16.516095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:16.517646 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:16.518524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:16.519571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:17.064338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:17.088414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2375246b-2216-4152-bccb-5b0f37dbc75f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1279 microversion: 2.1 time: 0.647919 Oct 23 00:08:17.092088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 25/52] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:16 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1279 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:17.102850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:17.103701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:17.115136 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:17.115810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:17.116544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:17.117460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:17.118056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:17.118822 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:17.119603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:17.143004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:17.149286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:17.152729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3bf06c50-9e13-4308-8aff-3f8f83003b51 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1338 microversion: 2.20 time: 0.666671 Oct 23 00:08:17.167201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 28/53] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:16 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1338 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:17.680691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:17.707149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-65c7120a-1abc-4a96-99e8-20c34b970f98 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.608666 Oct 23 00:08:17.710950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:17 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:18.116766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:18.117677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:18.128879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.132057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.137172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:18.138325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.145952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.149984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:18.181860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:18.182484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:18.190436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.197034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.197836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:18.202671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.204800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.208600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:18.679452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:18.702732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:18.707823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:18.717724 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b3335e0b-698c-4ed8-957b-fcc2711e253d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1338 microversion: 2.20 time: 0.537181 Oct 23 00:08:18.720344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 27/55] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:18 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:18.742283 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:18.742883 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:18.767935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.768356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.773726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:18.777256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:18.777766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:18.778225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:19.640386 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=4 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:19.687221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:19.696833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8ef2af67-6bbb-443b-a93d-d4aab9c863be tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 1.584607 Oct 23 00:08:19.715092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 29/56] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:18 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:19.748314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:19.750163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:19.764973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:19.766525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:19.769661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:19.772314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:19.773069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:19.776147 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:19.905078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:19.930801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-066c3c59-cbf2-42e9-abd0-f264562e47a7 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 1.200235 Oct 23 00:08:19.945234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 28/57] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:18 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:20.060816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:20.072933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:20.074410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:20.096014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d7085efc-b0ca-435f-9589-6afc5595d95c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1338 microversion: 2.20 time: 0.352402 Oct 23 00:08:20.111184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 30/58] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:19 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1338 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:20.624444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8efbb0ae-6061-43b8-8acc-dc0abe234a4a tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Action: 'create', calling method: .version_select at 0x7f3f8db668b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-999367904", "metadata": {"Type": "work"}}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:20.726708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:20.727369 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:20.738271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:20.738806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:20.739217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:20.747189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:20.748016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:20.750100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:20.888026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=4 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:20.936764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=16 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:21.524948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=20 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:22.098901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8efbb0ae-6061-43b8-8acc-dc0abe234a4a tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.748657 Oct 23 00:08:22.100478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 29/59] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 00:08:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1751 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 00:08:22.112527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:22.113542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:22.138940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:22.143469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:22.144954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:22.146592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:22.150446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:22.155875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:22.781239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:22.797020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7508828a-0145-400c-9de9-99c7edcf7209 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 2.075185 Oct 23 00:08:22.836888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:20 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:22.855162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:22.868892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:22.908667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:22.911483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:22.913151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:22.918333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:22.920152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:22.922726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.103583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:23.122601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f4cc6697-c026-4a38-9943-c60b65a75c03 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 1.017625 Oct 23 00:08:23.126101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 30/61] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:22 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:23.622741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:23.636941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:23.638568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:23.640150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ec5a622d-02e6-4172-ba5a-223adf3250ad tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.801155 Oct 23 00:08:23.642455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:22 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:23.649717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-86e5c94e-2a03-4dba-af76-08207b63257c tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Calling method '.version_select at 0x7f3f8db8ab80>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:23.736085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd9f246-af01-42f2-874c-e96df43a5eda", "tag": "ec7ae329-daa1-4671-ae98-43e3fdce1560"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:23.744429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-86e5c94e-2a03-4dba-af76-08207b63257c tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e" status: 200 len: 353 microversion: 2.1 time: 0.099949 Oct 23 00:08:23.745073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 33/63] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:23 2022] GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:23.759199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-41dfdc55-0045-4059-aba7-4b73c1dc7ffe tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Calling method '.version_select at 0x7f3f8dbcfdc0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:23.786503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:23.788683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:23.789134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.843915 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-41dfdc55-0045-4059-aba7-4b73c1dc7ffe tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e" status: 200 len: 353 microversion: 2.1 time: 0.088388 Oct 23 00:08:23.845789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Creating event network-changed:ec7ae329-daa1-4671-ae98-43e3fdce1560 for instance ffd9f246-af01-42f2-874c-e96df43a5eda on hv-cinder-86156 Oct 23 00:08:23.846678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 00:08:23.849374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-46f4974e-02eb-4ed4-922e-fee111bdbdc1 req-654025c9-6052-4ddb-9523-e9488d3b346a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 00:08:23.852409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:23.854578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:23.857143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.857266 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 34/64] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:23 2022] GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:23.860001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:23.860893 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:23.862912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:23.863527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:23.863904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.882233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:23.882986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:23.883571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.884406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:23.885068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:23.885666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:23.890734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.compute.rpcapi [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 00:08:23.893407 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] Releasing lock "compute-rpcapi-router" {{(pid=118855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 00:08:23.930849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d4b422d2-49d6-4df8-b3a5-dd9edbeed12a None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.802802 Oct 23 00:08:23.933025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 31/65] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:23.953134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fad55848-83dc-4f09-93a1-50ae9e684d28 tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Calling method '.version_select at 0x7f3f8dbe14c0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:24.088430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fad55848-83dc-4f09-93a1-50ae9e684d28 tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e" status: 202 len: 0 microversion: 2.1 time: 0.148761 Oct 23 00:08:24.093287 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 32/66] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:08:23 2022] DELETE /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:08:24.102102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-307cc5c5-7d6d-49d7-85d2-5610761d792e tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Calling method '.version_select at 0x7f3f8db668b0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:24.304187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-307cc5c5-7d6d-49d7-85d2-5610761d792e tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e" status: 200 len: 352 microversion: 2.1 time: 0.208377 Oct 23 00:08:24.310168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:24 2022] GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e => generated 352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:08:24.323684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:24.330813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:24.355120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:24.357576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:24.359671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:24.362950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:24.364222 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:24.367607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:24.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:24.813029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ad358a3f-8034-451a-9bc4-a1f560ab43ad tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.504304 Oct 23 00:08:24.816556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:24 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:24.835227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:24.854251 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-09edfa13-f153-47d7-9a18-ea2040834110 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.995815 Oct 23 00:08:24.856821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:23 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:24.873842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:24.878184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:24.905014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:24.908592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:24.909092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:24.909896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:24.914121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:24.914784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:25.398962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c788f89c-5620-4a79-aca6-4b2dce29abc0", "tag": "297fd16c-502d-4af5-8b87-28b1cc7bdb86"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:25.415069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:25.419586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:25.423854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:25.485784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] Creating event network-changed:297fd16c-502d-4af5-8b87-28b1cc7bdb86 for instance c788f89c-5620-4a79-aca6-4b2dce29abc0 on hv-cinder-86156 Oct 23 00:08:25.493515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-ca5dd4f1-5074-4492-83e3-35e9d6478ba9 req-0f1bce7b-4412-47ba-b1a0-724171e9eee4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.674932 Oct 23 00:08:25.496018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 35/70] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:25.505573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c1491923-774e-4b81-aa5a-f0ab8867e9cd tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Calling method '.version_select at 0x7f3f8db9b4c0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:25.557174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-c1491923-774e-4b81-aa5a-f0ab8867e9cd tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] HTTP exception thrown: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c1491923-774e-4b81-aa5a-f0ab8867e9cd tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Request method failure captured: Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e HTTP/1.1 Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIX0BhEZl3xs9g4s4Sa50BfKTvqTnHM6ULAZX8HhcFclmmIbpeH-C8eYsAsl-_KLknX_x6crHMvvVUz9OfiAlZ_6fWzZAtTQIgz0HZBKacGSazAmi3pLWeBtLJDwWnopkdQ4q0auGPJboAUZWq4FFKJL-V_zeLOlOXxrYTuTu3tKeBA Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 08d343eb97fc46e29e2ba18751273dbf Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesGetTestJSON-1950662747 Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:08:25.560255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08d343eb97fc46e29e2ba18751273dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08d343eb97fc46e29e2ba18751273dbf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08d343eb97fc46e29e2ba18751273dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08d343eb97fc46e29e2ba18751273dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesGetTestJSON-1950662747 Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 08d343eb97fc46e29e2ba18751273dbf Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesGetTestJSON-1950662747 Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesGetTestJSON-1950662747-project Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 044624f790b243ee895ae65c4fa729eb Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesGetTestJSON-1950662747-project Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '475182d5-df0c-4292-9295-1a7e1f13ed2e'} Oct 23 00:08:25.561728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. (HTTP 404) (Request-ID: req-b5afb37b-6340-401a-8421-68c4ea299dba) Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:25.562560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:08:25.563777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 00:08:25.564948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. Oct 23 00:08:25.566094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:08:25.570507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c1491923-774e-4b81-aa5a-f0ab8867e9cd tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] Returning 404 to user: Volume 475182d5-df0c-4292-9295-1a7e1f13ed2e could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:08:25.571864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c1491923-774e-4b81-aa5a-f0ab8867e9cd tempest-VolumesGetTestJSON-1950662747 tempest-VolumesGetTestJSON-1950662747-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e" status: 404 len: 109 microversion: 2.1 time: 0.073680 Oct 23 00:08:25.572589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 36/71] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:08:25 2022] GET /compute/v2.1/os-volumes/475182d5-df0c-4292-9295-1a7e1f13ed2e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:25.598237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:25.618661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:25.621684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:25.642513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b3ee5575-b527-4b91-9881-aa9a97c46589 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.767210 Oct 23 00:08:25.642513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:24 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:25.844141 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:25.848303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:25.890116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:25.890116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:25.895068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:25.899850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:25.900306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:25.901801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:25.902390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:25.909163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:25.909950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:25.910882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:25.918897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:25.920107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:25.921213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:25.921921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.023994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:27.036778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d06ed8b3-15d2-40b0-8e58-47740f50a0cc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 1.158289 Oct 23 00:08:27.037982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:25 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:27.053697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:27.063451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a760feb7-351d-4012-a17e-ba371a9d1dda tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 1.227100 Oct 23 00:08:27.064709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 37/74] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:25 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:27.070703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:27.071722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:27.072232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9595d516-aac5-4107-9664-b4c76e761937", "tag": "0bd87e24-ad08-45e5-a314-9943cb013d2d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:27.079161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.080180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.080891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.081812 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.082473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.083114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.119995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.120516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.128657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.253948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Creating event network-changed:0bd87e24-ad08-45e5-a314-9943cb013d2d for instance 9595d516-aac5-4107-9664-b4c76e761937 on hv-cinder-86156 Oct 23 00:08:27.254557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 00:08:27.258010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7f47016f-8ac1-4cff-9742-d40eca3cb7d4 req-2a18fe89-3e3d-4c27-b220-e3975f5f32ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=118854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 00:08:27.267741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.269404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.270300 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.275102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.276081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.276794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.304912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.compute.rpcapi [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 00:08:27.307784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] Releasing lock "compute-rpcapi-router" {{(pid=118854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 00:08:27.357300 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-00f83277-e469-485c-92e5-d2ecd1553f1d None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317509 Oct 23 00:08:27.361284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 38/75] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:27.465057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:27.478418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:27.481128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:27.485955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3c4ddca9-0d7e-4fe2-9829-b41ac8c9ee41 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.418970 Oct 23 00:08:27.486528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:27 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:27.596347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:27.607192 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:27.610278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:27.610658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:27.623862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] Creating event network-changed:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:08:27.627057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-bf686cb6-ba0f-4015-90cb-d5a6960e0823 req-8929207a-3d72-45a6-818d-4de7b21e4c2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 Oct 23 00:08:27.628021 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 39/77] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:28.063442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:28.064383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:28.073399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.074344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.074792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:28.075504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.075956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.076566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:28.093493 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:28.094324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:28.128806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.129372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.129838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:28.130757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.131164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.131528 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:28.325632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:28.335084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4e6208ef-a274-4a3c-9415-9fbf505ba8e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.276594 Oct 23 00:08:28.336308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 39/78] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:28 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:28.379771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:28.390637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3475461a-ef59-4503-b708-d0f0824acae9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.303107 Oct 23 00:08:28.391709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 40/79] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:28 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:28.512231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:28.512891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:28.523788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.524281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.524774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:28.525478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:28.525904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:28.526395 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:29.132860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:29.137127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:29.153604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:29.156335 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:29.158163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a34f6369-cc35-488e-a9e8-70401d197fb9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.649801 Oct 23 00:08:29.158965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 40/80] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:28 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:29.368323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:29.369117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:29.379633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:29.380179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:29.382768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:29.382768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:29.382768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:29.382768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:29.415254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:29.416135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:29.427185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:29.429102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:29.430341 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:29.431335 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:29.432441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:29.433095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:29.588459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:29.599086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d3651b55-6351-4ef3-becb-f0976f51ba80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.241027 Oct 23 00:08:29.613573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 41/81] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:29 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:29.625374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:29.633405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c96d8976-1607-4688-90f6-ebb655ab7b5b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.223979 Oct 23 00:08:29.634091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 41/82] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:29 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:30.184973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:30.186099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:30.195587 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.198081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.198548 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.199288 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.199757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.214651 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.492172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:30.496010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:30.507177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:30.510840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:30.511975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6798e625-7442-4d42-a0c1-b833be9433a3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.330993 Oct 23 00:08:30.514236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 42/83] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:30 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:30.625659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:30.626367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:30.631768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:30.633846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.635608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.636277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.637222 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.637862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.638522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.658645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:30.659309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:30.670024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.670532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.672284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.680010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:30.680591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:30.682624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:30.881440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:30.890495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dcba1d47-747f-41ce-8610-2566298a76dd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.270053 Oct 23 00:08:30.900532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 42/84] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:30 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:30.924672 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:30.932262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ca06af76-144e-4e2d-925c-029f54f70df3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.278958 Oct 23 00:08:30.944510 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 43/85] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:30 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:31.539421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:31.540030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:31.546411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.547073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.547510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:31.548197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.548675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.549096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:31.708602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:31.720126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:31.721934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:31.723267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fbda1530-79d1-4b11-ab2a-874cde3cf927 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.187603 Oct 23 00:08:31.724002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 43/86] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:31 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:31.914203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:31.914797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:31.922668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.923164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.923735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:31.924437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.924917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.925333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:31.958968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:31.960474 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:31.972358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.973269 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.974117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:31.975287 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:31.976520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:31.977733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:32.259770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:32.272921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-12b0c0b1-189e-4ab8-a6fe-46abe32c0bd4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.359729 Oct 23 00:08:32.272921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 44/87] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:31 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:32.290828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:32.299584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d9dbc953-c837-4cf3-9d2f-84e9bb07ab07 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.347565 Oct 23 00:08:32.300163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 44/88] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:31 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:32.756141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:32.756866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:32.759789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:32.764525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:32.765437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:32.765826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:32.766580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:32.767068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:32.767682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:32.968298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:32.977591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:32.979262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:32.980398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c6bbd88c-41c0-4cdb-9cbe-11816a5f209c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.231959 Oct 23 00:08:32.980997 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 45/89] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:32 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:33.294190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:33.295364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:33.301794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:33.302279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:33.302711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:33.303391 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:33.303839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:33.304261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:33.324093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:33.324891 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:33.332344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:33.333208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:33.333804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:33.334720 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:33.335425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:33.335795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:33.560197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:33.568294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:33.569763 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-94f7a5f1-b125-47bb-9db4-9cf714178507 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.278999 Oct 23 00:08:33.570342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 45/90] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:33 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:33.579816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ab549008-ad2a-4395-9689-482ce3957170 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.260293 Oct 23 00:08:33.581009 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:33 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:34.006393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:34.007004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:34.008831 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:34.014266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.015367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.015798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.016878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.017512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.018109 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.154337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:34.163467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:34.165002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:34.166180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8b6e75bf-c7a1-4711-afd8-ad3218edba5d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.163574 Oct 23 00:08:34.166620 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 46/92] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:34 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:34.593408 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:34.594034 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:34.600058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.600583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.601097 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.601711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.602171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.602602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.605039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:34.605715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:34.612865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.613443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.613956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.614728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:34.615286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:34.615787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:34.820102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:34.834777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:34.834950 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-aa502aaf-82b6-4743-a36c-4dd95c9773e3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.245719 Oct 23 00:08:34.835475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 47/93] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:34 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:34.847264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a5e94690-3278-4470-834c-c7259be1c02d tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.245503 Oct 23 00:08:34.848961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:34 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:35.192744 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:35.193697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:35.199966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.200624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.201259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:35.202250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.202922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.203529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:35.372326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:35.382537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:35.384136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:35.385285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fe759bce-a780-49e9-9e54-b228203bfb45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.196895 Oct 23 00:08:35.393747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 48/95] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:35 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:35.873572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:35.874767 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:35.875170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:35.875249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:35.881397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.881880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.882159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.882314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:35.882701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.883180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.883305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:35.883626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.884218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:35.884790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:35.885402 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:35.886694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:36.118146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:36.132405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ec309d2e-241b-4236-b260-75ee2d9a9adc tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.262756 Oct 23 00:08:36.133009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 48/96] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:35 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:36.168395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:36.177861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dd60c968-63e4-4f2e-9ca2-79a95c20fcfc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.308153 Oct 23 00:08:36.178815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 49/97] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:35 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:36.418149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:36.418821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:36.424874 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:36.425350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:36.425777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:36.426628 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:36.427222 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:36.427784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:36.631381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:36.641596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:36.643048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:36.644172 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b7022c87-a164-4361-aad3-c941431e0710 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.229933 Oct 23 00:08:36.644775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 49/98] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:36 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:37.158635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:37.159317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:37.166178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.166855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.167379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.168138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.168692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.169318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.201138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:37.203165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:37.211312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.212052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.212899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.214247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.214877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.215499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.299840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:37.380601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:37.395208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-951c5828-57f2-45e2-949f-5c692cb94a63 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.239877 Oct 23 00:08:37.396201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:37 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:37.443012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:37.452824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b2cde59d-b789-4f63-b240-16e671ca6776 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.255249 Oct 23 00:08:37.461885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 50/100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:37 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:37.672122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:37.672758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:37.678619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.679096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.679525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.680243 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:37.682162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:37.682590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:37.820864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:37.830279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:37.831894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:37.833225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e9acc6ba-2edc-4934-8edd-b7e4f8ea6e99 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.165621 Oct 23 00:08:37.833855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 51/101] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:37 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:38.419497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:38.420233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:38.427388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.427884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.428324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.429034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.429487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.429905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.478020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:38.478989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:38.485375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.485958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.486679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.487483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.488038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.488584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.703578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:38.708513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1be7c726-6759-42c7-9abd-b63650a3a626 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.292740 Oct 23 00:08:38.709345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 51/102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:38 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:38.729779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:38.738655 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6b5239bc-7f9d-435f-a678-801fd82cf6a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.264409 Oct 23 00:08:38.739236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 52/103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:38 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:38.857721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:38.858498 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:38.864188 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.864709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.865144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.865858 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:38.866314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:38.866732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:38.993669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:39.001921 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:39.003398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:39.004537 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-090ebf69-1dd1-4128-9f48-73ea46d03fcc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.150676 Oct 23 00:08:39.005092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 52/104] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:38 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:39.741516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:39.741516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:39.745733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:39.746222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:39.746668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:39.747452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:39.748016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:39.748686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:39.767010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:39.767689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:39.777373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:39.778984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:39.779503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:39.782527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:39.783464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:39.784659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:39.964643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:39.973210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-98c6abfd-a6de-4f03-9d95-461e848cfdcd tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.239962 Oct 23 00:08:39.974234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 53/105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:39 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:40.004738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:40.012301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4c122455-b4d0-492d-95e7-d1f442c3c3fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.253458 Oct 23 00:08:40.012922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 53/106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:39 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:40.030639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:40.031543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:40.038049 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:40.038533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:40.038980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:40.039741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:40.040118 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:40.040577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:40.192151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:40.200307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:40.201781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:40.203574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-05f77822-82b5-4d91-801e-fc79496b9cab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.177459 Oct 23 00:08:40.204179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 54/107] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:40 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:41.003202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:41.003823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:41.013555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.014371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.015597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.016872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.017660 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.020931 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.038017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:41.038969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:41.052733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.053278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.053648 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.054345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.054795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.055219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.313233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:41.330508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2d5c3fc7-095b-43b2-94ab-ecead0e92eeb tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.328705 Oct 23 00:08:41.331455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 54/108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:40 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:41.345683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:41.347236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:41.364169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.364883 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.365525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.367692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.369138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.369728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.518954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:41.526836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c2407b3a-f3ea-4843-adb6-cfadf53ebda9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.494949 Oct 23 00:08:41.531930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 55/109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:41 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:41.705922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:41.716826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:41.720084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:41.721860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9e60cf7f-cac9-4826-8442-0fd75c8044d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.388584 Oct 23 00:08:41.723191 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 55/110] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:41 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:41.869835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c788f89c-5620-4a79-aca6-4b2dce29abc0", "name": "network-vif-plugged", "status": "completed", "tag": "297fd16c-502d-4af5-8b87-28b1cc7bdb86"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:41.888384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:41.889106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:41.890415 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:41.927729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] Creating event network-vif-plugged:297fd16c-502d-4af5-8b87-28b1cc7bdb86 for instance c788f89c-5620-4a79-aca6-4b2dce29abc0 on hv-cinder-86156 Oct 23 00:08:41.934942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-ed2aeb1c-7be8-4416-beb3-2593729f5179 req-33358b1a-ee86-4717-a117-bea55a0cb7da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155346 Oct 23 00:08:41.935705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 56/111] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:08:42.361912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:42.362530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:42.368342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.368864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.369309 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.370003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.370460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.370884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.557136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:42.558114 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:42.562500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:42.565164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.565892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.566329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.567020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.567626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.568051 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.572003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0fb0c25a-6efc-4bed-b458-c364b72158b9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.213485 Oct 23 00:08:42.572003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 56/112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:42 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:42.750575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:42.751528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:42.758881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.759393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.759838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.760589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:42.761803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:42.762235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:42.785644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:42.920678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:42.929101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4745ca1e-1dc7-4077-8c73-05418b77ebbf tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.376180 Oct 23 00:08:42.932768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 57/113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:42 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:42.980937 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:42.990083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:42.991673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:42.992952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7d17b46e-7906-467b-9cee-0244ae945333 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.246690 Oct 23 00:08:42.993624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 57/114] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:42 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:43.598748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:43.599290 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:43.605192 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:43.605677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:43.606110 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:43.606787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:43.607244 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:43.607705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:43.737991 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:43.745710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-48b5e4c3-1089-4781-8d0d-63f73db5d680 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.150826 Oct 23 00:08:43.746439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:43 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:43.953471 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:43.954744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:43.960774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:43.961411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:43.962211 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:43.963062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:43.963669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:43.964267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:44.019735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:44.020467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:44.031888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:44.032142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:44.033491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:44.034209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:44.034668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:44.037019 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:44.192664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:44.204341 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-14863f4f-45b5-46a1-8542-90db3a8a3c80 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.255396 Oct 23 00:08:44.205355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 58/116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:43 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:44.223830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:44.232690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:44.234659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:44.235765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f6bbefe3-58b3-4af7-8e64-274cdd768688 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.220931 Oct 23 00:08:44.236612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 59/117] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:44 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:44.772224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:44.772890 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:44.779038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:44.779577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:44.780042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:44.780862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:44.781288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:44.781719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:44.911071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:44.918807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-38e610de-f1c7-43f5-9fe2-72537143b30b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.150441 Oct 23 00:08:44.919377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 59/118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:44 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:45.227665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:45.228276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:45.237453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.238350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.238788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:45.239545 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.240006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.240434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:45.248627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:45.262308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:45.262910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:45.269810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.270365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.270710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:45.271398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.271843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.272259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:45.450844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:45.458645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4f8dca2f-2aea-4347-955c-3d65a3b30b54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.234968 Oct 23 00:08:45.459212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 60/119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:45 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:45.464530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:45.473240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:45.474666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:45.475751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d9e8f9da-4f6b-49f6-b5c0-36a20a321724 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.217644 Oct 23 00:08:45.476299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 60/120] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:45 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:45.942484 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:45.943099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:45.948979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.949454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.949889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:45.950580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:45.951034 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:45.951454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:46.083557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:46.091112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-71fd9ac2-3ead-4db2-bddf-3d27eb6b4662 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.152496 Oct 23 00:08:46.091693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 61/121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:45 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:46.482113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:46.482680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:46.489096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:46.489571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:46.489999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:46.490672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:46.491117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:46.491533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:46.502186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:46.502793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:46.513533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:46.514018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:46.514451 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:46.515304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:46.515755 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:46.516175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:46.701011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:46.703390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:46.710993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0ac29401-9fc9-4d1e-8082-d958f45fd9ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.232601 Oct 23 00:08:46.711586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 61/122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:46 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:46.712786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:46.714474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:46.715817 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9f908a08-2134-4d13-a631-b301e36d3048 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.218392 Oct 23 00:08:46.729124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 62/123] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:46 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:47.114499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:47.115112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:47.121038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.121510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.121942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.122638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.123097 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.123559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.255638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:47.263795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b0aa1df7-46f2-4ad1-a70f-6618f60bb9ec tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.153179 Oct 23 00:08:47.264431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 62/124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:47 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:47.740357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:47.741018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:47.743744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:47.744514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:47.748166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.749709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.750249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.751364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.752297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.753071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.753444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.753942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.754419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.755405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:47.755903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:47.756361 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:47.969825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:47.978059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:47.979567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:47.980804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b4dc62ba-e329-4c76-b2f0-5d5b60849750 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.241631 Oct 23 00:08:47.981431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 63/125] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:47 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:47.984283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:47.991864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cba70182-1fea-49c1-9291-b3aee1d19270 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.260439 Oct 23 00:08:47.992630 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 63/126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:47 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:48.286106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:48.286719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:48.292562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:48.293047 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:48.293480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:48.294160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:48.294613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:48.295034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:48.446423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:48.464174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a2c0dbbe-0798-47d6-8c14-eb18a4f210e3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.181783 Oct 23 00:08:48.464972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 64/127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:48 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:48.939417 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd9f246-af01-42f2-874c-e96df43a5eda", "name": "network-vif-plugged", "status": "completed", "tag": "ec7ae329-daa1-4671-ae98-43e3fdce1560"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:08:48.951463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:48.952011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:48.953413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:48.965679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] Creating event network-vif-plugged:ec7ae329-daa1-4671-ae98-43e3fdce1560 for instance ffd9f246-af01-42f2-874c-e96df43a5eda on hv-cinder-86156 Oct 23 00:08:48.972716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-57106e8b-4a9c-439c-af4b-16a5b94e4358 req-4006de54-2031-4b22-b308-a60f26eeae20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038838 Oct 23 00:08:48.973636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 64/128] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:08:49.018348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:49.019611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:49.026011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:49.026938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.027073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:49.027681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.028275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.029189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.029941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.030925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.035199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.035688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.036127 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.036992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.037559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.038037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.355168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:49.371077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:49.373214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:49.374688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6bdb4547-c414-4e06-92cf-559924632a59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.360980 Oct 23 00:08:49.386735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 65/129] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:49 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:49.500754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:49.500754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:49.502626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:49.510969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.511837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.512775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.516453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:49.516970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:49.517516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:49.520940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1be73ea2-8dd9-415e-9935-c5471fcbb15d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.500888 Oct 23 00:08:49.534327 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 65/130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:49 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:49.783677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:49.798917 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dcf92807-5e75-4363-b30f-86bfd228fb9a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.313374 Oct 23 00:08:49.806528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 66/131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:49 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:50.401612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:50.402365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:50.408802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.409373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.409850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.410553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.411038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.411500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.559296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:50.559992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:50.560619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:50.567651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.567801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:50.568140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.568602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.569138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:50.569841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.570717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dca86e1b-2598-49b3-b690-accc29aae45a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.173535 Oct 23 00:08:50.571098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.571264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 66/132] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:50 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:08:50.582232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.738922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:50.746417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-194d3587-9cc6-4148-866e-8bc5c831af1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.192230 Oct 23 00:08:50.747071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 67/133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:50 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:50.823414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:50.824031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:50.830604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.831086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.831522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.832212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:50.832713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:50.833143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:50.966208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:50.981222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-61538bbb-87eb-4af9-908f-c35a6df39c66 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.161769 Oct 23 00:08:50.981797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 67/134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:50 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:51.599571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:51.600181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:51.606837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:51.607338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:51.607858 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:51.609860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:51.609860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:51.610315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:51.747170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:51.760791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:51.762317 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:51.763615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ea21871b-435c-4b29-a732-807d85bc7028 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.168140 Oct 23 00:08:51.771079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 68/135] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:51 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:51.772874 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:51.774008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:51.780448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:51.781483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:51.781918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:51.782604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:51.783053 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:51.783472 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:51.918062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:51.928665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-de78c864-6018-40c5-8aca-6695ceaccbb2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.159481 Oct 23 00:08:51.929354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 68/136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:51 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:52.005681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:52.006330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:52.012176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.012700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.013147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:52.013867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.014350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.015547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:52.153119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:52.163287 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f6245a52-d50b-4bba-b6ff-dccd7ef11241 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.161411 Oct 23 00:08:52.164861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 69/137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:52 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:52.789758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:52.790350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:52.797086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.797623 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.798064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:52.798758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.799236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.799656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:52.945348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:52.952653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:52.953274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:52.953919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:52.955539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:52.956748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c0378693-55d7-410f-8f2e-6e8188482634 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.171495 Oct 23 00:08:52.957323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 69/138] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:52 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:52.975723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.975723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.975723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:52.975723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:52.976264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:52.976264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:53.111016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:53.120173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f98d23b5-863f-40ff-8e8e-51a42786ce55 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.172378 Oct 23 00:08:53.126829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:52 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:53.187518 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:53.188525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:53.196583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:53.197077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:53.197513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:53.204658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:53.205150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:53.205591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:53.349521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:53.357207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e57ec923-dd65-443f-b027-e9dfa19b09aa tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.174063 Oct 23 00:08:53.357763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 70/140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:53 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:53.983690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:53.984065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:53.989850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:53.990329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:53.990819 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:53.991504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:53.991954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:53.992382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:54.141489 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:54.143881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:54.144906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:54.151011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:54.151202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:54.151504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:54.151942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:54.152664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:54.153115 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:54.153510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:54.153632 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:54.154876 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-296c3825-8a9e-4e57-916d-d481c9d8eae9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.175694 Oct 23 00:08:54.169366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 71/141] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:53 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:54.307274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:54.315750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6fdf6268-1f68-4d5b-a037-59d59c517ed1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.176326 Oct 23 00:08:54.316901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 71/142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:54 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:54.383290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:54.383943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:54.390469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:54.391054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:54.391490 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:54.392190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:54.392673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:54.393270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:54.571024 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:54.579412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9a1ef58e-8fc9-494e-9816-4eba95c359ce tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.200028 Oct 23 00:08:54.579985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 72/143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:54 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:55.182018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:55.182728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:55.189450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.189989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.190419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.191110 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.191620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.192055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.348087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:55.349446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:55.360626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.361514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.362976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.363940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.364554 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.364988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.366730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:55.377400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:55.378841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:55.380130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5a18ecc8-561e-41ee-a033-bfde35428352 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.202056 Oct 23 00:08:55.380728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 72/144] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:55 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:55.523655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:55.536712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c99b5903-f517-451d-a09a-dcead79055e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.190693 Oct 23 00:08:55.550983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 73/145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:55 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:55.605888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:55.606498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:55.613757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.614247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.614937 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.615526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:55.616651 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:55.617079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:55.778536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:55.789595 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-80d5ca02-ddf3-4383-999e-6c2e8b3e5e0f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.187512 Oct 23 00:08:55.805088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 73/146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:55 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:56.405920 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:56.406586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:56.412697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.413171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.413599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:56.414276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.414718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.415131 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:56.419076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:56.563554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:56.564384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:56.571213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.571795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.575320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:56.576247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:56.577066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.577855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.578430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:56.583783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:56.585326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:56.586627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-85f4bf28-555e-4fa8-a5a0-523af74b2b68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.184766 Oct 23 00:08:56.587863 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 74/147] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:56 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:56.832434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:56.834010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:56.866160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.866663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.867277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:56.868174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:56.868672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:56.869105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:57.013880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:57.042153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d9bb7188-3b57-44a1-b89a-a4fd9b5297a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.485098 Oct 23 00:08:57.042769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 74/148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:56 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:57.130733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:57.140958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fcf70674-c82f-4f36-bb74-95598ae35634 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.314000 Oct 23 00:08:57.155944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 75/149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:56 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:57.614633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:57.615057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:57.621158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:57.621649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:57.622090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:57.622780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:57.623235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:57.623678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:57.855059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:57.865150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:57.866601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:57.867711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8f13d8ad-9034-4722-befe-1ce309413978 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.257231 Oct 23 00:08:57.868385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 75/150] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:57 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:58.077771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:58.078699 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:58.084938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.085424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.086044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:58.086765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.087189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.087723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:58.167870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:58.168460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:58.175761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.176458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.177077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:58.177921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.178688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.179109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:58.276149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:58.286434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-920aa65d-1ec1-444d-afdf-bb5a8527fd0f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.213574 Oct 23 00:08:58.303001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 76/151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:58 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:58.386057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:58.396777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b3ac7c5e-e23f-46d9-872d-b96b41fa5258 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.232994 Oct 23 00:08:58.397643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 76/152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:58 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:08:58.894968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:58.896021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:58.908969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.908969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.908969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:58.908969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:58.909315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:58.909315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:59.059903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:59.069306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:59.071010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:59.072134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1dd563c5-0479-42c6-ae85-0437d3747231 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.181171 Oct 23 00:08:59.072725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 77/153] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:08:58 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:08:59.310449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:59.311497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:59.317954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:59.318513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:59.319167 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:59.319933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:59.320456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:59.320969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:59.341383 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:59.423104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:08:59.424689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:08:59.431497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:59.432337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:59.432953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:59.433992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:08:59.434935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:08:59.435544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:08:59.477181 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:59.489118 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3883a415-2eb5-4945-a150-94d0373f936a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.181974 Oct 23 00:08:59.490342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 77/154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:59 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:08:59.597073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:08:59.606082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2d479152-3c9d-42b2-bb43-83869f913385 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.189081 Oct 23 00:08:59.606671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 78/155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:08:59 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:00.097875 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:00.098465 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:00.104781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.105675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.106309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.107441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.108342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.109745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.277884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:00.287236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:00.288716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:00.289835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-99285eef-058b-4216-999c-618870f587aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.196124 Oct 23 00:09:00.290393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 78/156] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:00 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:00.513222 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:00.513866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:00.520359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.521119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.521585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.522265 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.522721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.523188 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.630793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:00.632718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:00.639570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.640660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.641466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.643050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:00.643698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:00.644393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:00.699836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:00.717180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-51d135ff-e11a-47eb-a7b5-ab8a447d7907 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.207572 Oct 23 00:09:00.719872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 79/157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:00 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:09:00.829560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:00.840412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b2d1fe9e-9c6d-4f6e-940d-834d0a8319f5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.213005 Oct 23 00:09:00.841303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 79/158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:00 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:01.315059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:01.315666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:01.317517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=76 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:01.322600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.323099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.323517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.324202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.324682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.325106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.454590 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:01.462667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:01.464112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:01.465256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6feb6dbe-4577-4517-9058-913af7420952 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.154760 Oct 23 00:09:01.465823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 80/159] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:01 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:01.742890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:01.743410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:01.750017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.750586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.751091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.751893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.752364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.752814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.864353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:01.864986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:01.870846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.871324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.871748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.872431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:01.872903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:01.873322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:01.884121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:01.892210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7860ad4c-53df-4d5d-a97a-ec254c30bfa2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.153259 Oct 23 00:09:01.892797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 80/160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:01 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:02.010497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:02.018743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e0115729-c9c9-4627-b989-ccb57bb3ebf8 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.158028 Oct 23 00:09:02.019475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 81/161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:01 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:02.491552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:02.492261 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:02.498421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:02.498903 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:02.499587 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:02.500282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:02.500769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:02.501193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:02.630435 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:02.638375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:02.640957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:02.642060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-145cc3c0-5902-4200-bc27-c675c18c4dc1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.154805 Oct 23 00:09:02.642621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 81/162] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:02 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:09:02.918499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:02.919271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:02.926574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:02.927151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:02.927796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:02.928572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:02.929318 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:02.930122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:03.044340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:03.044974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:03.048476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=74 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:03.054584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:03.055067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:03.057179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:03.057894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:03.058372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:03.058830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:03.088163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:03.102357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-32c11024-6b67-416f-9261-e65110f46f52 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.189917 Oct 23 00:09:03.113444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 82/163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:02 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:03.222085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:03.231697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d897b78c-ab0f-49ce-a8a0-c9c38b1e94e9 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.191046 Oct 23 00:09:03.232634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 82/164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:03 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:03.667295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:03.668072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:03.674193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:03.674679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:03.675113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:03.675891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:03.676821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:03.677467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:03.836202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:03.845262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:03.846696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:03.847822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5d09c512-91ac-49da-a856-3e38764c5eb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.184582 Oct 23 00:09:03.848413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 83/165] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:03 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:04.129105 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:04.129716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:04.136853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.137352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.137770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.138453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.138909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.139328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.259645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:04.260253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:04.267829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.268568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.269001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.269700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.270155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.270583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.281043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:04.297734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-29dbba28-864b-4d8b-b2bc-a14238601798 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.173036 Oct 23 00:09:04.299478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 83/166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:04 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:04.440992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:04.452726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-be80ba7b-c67b-40cc-bc78-349c62c0bc83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1313 microversion: 2.1 time: 0.196230 Oct 23 00:09:04.461851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 84/167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:04 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:04.634222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9595d516-aac5-4107-9664-b4c76e761937", "name": "network-vif-plugged", "status": "completed", "tag": "0bd87e24-ad08-45e5-a314-9943cb013d2d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:04.645031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.645550 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.645938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.666920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] Creating event network-vif-plugged:0bd87e24-ad08-45e5-a314-9943cb013d2d for instance 9595d516-aac5-4107-9664-b4c76e761937 on hv-cinder-86156 Oct 23 00:09:04.674043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-c8692d2a-bc49-404a-9f9b-5f3f40ea003c req-aaf76078-2fd4-4205-88ba-e3bb261a1656 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043379 Oct 23 00:09:04.674853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 84/168] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:09:04.873101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:04.873710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:04.879874 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.880354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.880822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:04.881502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:04.881961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:04.882382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:05.036271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:05.045656 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:05.048872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:05.048872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-70b5e82b-a7ae-46ed-8129-3445f27b5de7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.179278 Oct 23 00:09:05.049196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 85/169] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:04 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:05.328084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:05.328437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:05.334488 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:05.334975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:05.335411 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:05.336099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:05.336614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:05.337036 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:05.471901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:05.480984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:05.482071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:05.491390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:05.491764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-14c746e4-c477-4357-98ac-4572a71ab4b1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.168783 Oct 23 00:09:05.492310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 85/170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:05 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:05.495822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:05.496275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:05.497026 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:05.497491 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:05.497919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:05.646763 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:05.654464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a259df4d-dc27-462c-a86d-c6bda057b910 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1501 microversion: 2.1 time: 0.178995 Oct 23 00:09:05.655029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 86/171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:05 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:06.074198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:06.074813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:06.081134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:06.081619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:06.082054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:06.082802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:06.083171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:06.083592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:06.230260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:06.238362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:06.239791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:06.240970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-992164ec-eae5-4ac7-9947-952508131164 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.170487 Oct 23 00:09:06.241522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 86/172] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:06 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:06.522295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:06.523007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:06.528857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:06.529619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:06.530045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:06.530732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:06.531179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:06.531598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:06.667717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:06.676181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e28569cc-6c6c-4794-82a4-8a29b7a20b17 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.163100 Oct 23 00:09:06.676758 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 87/173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:06 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:07.265949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:07.266489 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:07.272342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:07.272840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:07.273265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:07.273949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:07.274426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:07.274848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:07.404471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:07.414992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:07.416426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:07.417561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-21f69bbd-641c-42cf-b0a0-e4d4a2e69dd0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.155958 Oct 23 00:09:07.418117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 87/174] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:07 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:07.699021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:07.699627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:07.706049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:07.706537 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:07.706973 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:07.707663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:07.708116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:07.708576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:07.836649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:07.844942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c0ff2f13-fe5f-4d47-8676-eb323e1bfbeb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.149610 Oct 23 00:09:07.845502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 88/175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:07 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:08.442682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:08.443288 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:08.449157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:08.449503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:08.449936 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:08.450621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:08.451072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:08.451517 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:08.584282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:08.592329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:08.594849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:08.595977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3b3a6d78-a82c-4235-ac13-73cbc5c6266e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.157235 Oct 23 00:09:08.596570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 88/176] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:08 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:08.866898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:08.867500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:08.873297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:08.873770 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:08.874928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:08.875794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:08.876253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:08.876705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:09.003514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:09.011082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-42d45f3a-c406-4b97-9941-ab5d691e0990 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.147987 Oct 23 00:09:09.011645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 89/177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:08 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:09.622148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:09.622747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:09.629328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:09.629803 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:09.630230 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:09.630906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:09.631348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:09.631761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:09.766324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:09.775653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:09.777786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:09.779429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f6e106a7-9b4f-47e6-a1c6-9b1b6612c070 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.161048 Oct 23 00:09:09.780093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 89/178] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:09 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:10.034572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:10.035302 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:10.041303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:10.041887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:10.042419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:10.043215 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:10.043767 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:10.044285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:10.175764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:10.179195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:10.184352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1d18deef-0b88-45b9-9f2a-60bb865f375c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.154112 Oct 23 00:09:10.184949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 90/179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:10 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:10.804006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:10.804726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:10.813872 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:10.814339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:10.814770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:10.815487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:10.815937 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:10.816356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:10.956223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:10.965730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:10.967479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:10.970543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7eefd67e-4959-4c82-9645-84bc2d4fcaba tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.170260 Oct 23 00:09:10.971406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 90/180] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:10 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:11.209202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:11.209822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:11.214285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "name": "network-vif-plugged", "status": "completed", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:11.216040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:11.216518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:11.217517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:11.219168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:11.219853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:11.220414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:11.226631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:11.227098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:11.227724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:11.242119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] Creating event network-vif-plugged:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:09:11.247554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-5c909abe-9981-419a-8908-b677ee8b6351 req-841e2624-fa9a-43c8-ab94-0d72c0fe60f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040172 Oct 23 00:09:11.248769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 91/181] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:09:11.367239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:11.375634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b3f0647b-cf1f-458b-b9d5-cdc4573431e7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.170956 Oct 23 00:09:11.376210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 91/182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:11 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:11.996369 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:11.997014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:12.003669 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:12.004139 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:12.004592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:12.005269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:12.005710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:12.006123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:12.140316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:12.148584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:12.150064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:12.151232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-36bfbe31-c4c4-4b9a-ac84-4292f1b2d853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.159164 Oct 23 00:09:12.151848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 92/183] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:11 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:12.401787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:12.402393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:12.408945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:12.409426 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:12.409861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:12.410545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:12.410997 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:12.411421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:12.545930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:12.554508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-367b25a6-5a0a-4500-a8a1-4dde34525ca7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.156553 Oct 23 00:09:12.555925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 92/184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:12 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:13.175835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:13.176571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:13.182539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:13.183016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:13.183450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:13.184137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:13.184628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:13.185050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:13.312960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:13.320932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:13.322368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:13.323476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0ef85c05-95c0-46ff-96de-7860805cae0a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.152199 Oct 23 00:09:13.324040 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 93/185] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:13 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:13.579124 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:13.579731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:13.585632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:13.586104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:13.586529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:13.587235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:13.587677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:13.588095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:13.716092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:13.724732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-13bf1c0d-d06a-4946-ba8d-fdfafec720c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.150257 Oct 23 00:09:13.725290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 93/186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:13 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:14.349372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:14.350013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:14.355854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:14.356324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:14.356781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:14.357459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:14.357903 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:14.358318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:14.488426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:14.496465 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:14.497953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:14.499160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-520173ba-fbc0-4872-ad05-bf512f3a87d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.153565 Oct 23 00:09:14.499789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 94/187] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:14 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:14.747411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:14.747959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:14.755414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:14.755854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:14.756359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:14.757176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:14.757686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:14.758105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:14.889247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:14.896959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2360b175-671d-416c-9698-bfb72a071219 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.153444 Oct 23 00:09:14.897517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 94/188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:14 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:15.523087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:15.523750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:15.529766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:15.530285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:15.530987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:15.531422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:15.531874 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:15.532323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:15.550088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:15.662825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:15.670953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:15.672395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:15.673533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-923b8a0b-7f6c-4a1c-a3db-b22d6bb76a9d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.154416 Oct 23 00:09:15.674090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 95/189] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:15 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:15.919079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:15.919952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:15.926148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:15.926801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:15.927366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:15.928149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:15.928731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:15.929250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:16.149851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:16.158169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bb032987-9c79-4b92-8b7c-189cfb3764e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.242948 Oct 23 00:09:16.158728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 95/190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:15 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:16.556974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd518a2e-fb28-49fe-81d7-46124298f53f"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:16.559283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:16.566810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:16.567292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:16.567725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:16.568414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:16.568899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:16.569314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:16.698610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:16.701885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:16.714769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:16.716032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:16.716701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:16.717398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:16.718707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:16.719261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:16.854237 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:16.862194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:16.863621 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:16.864728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d1313f8e-ad00-46d0-9cc4-e794ec0564cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.170099 Oct 23 00:09:16.865278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 96/191] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:16 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:17.181605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:17.182306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:17.189357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:17.189936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:17.190376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:17.191130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:17.191587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:17.192015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:17.329382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:17.337259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c7aa8a41-2049-4673-966f-6bc3a882b950 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1321 microversion: 2.1 time: 0.160362 Oct 23 00:09:17.337949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 97/192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:17 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:17.891079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:17.891673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:17.897436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:17.897965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:17.898401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:17.899077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:17.899600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:17.899942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.028880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:18.038262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:18.039725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:18.040882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-597f03e4-08ad-47f3-bca6-c0ab3aa78f1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1405 microversion: 2.20 time: 0.154069 Oct 23 00:09:18.041437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 98/193] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:17 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:09:18.367344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:18.367959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:18.375956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.376712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.377354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.378380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.378902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.379517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.533995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:18.543968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bb402da3-9ae6-456b-8d52-d71a400c13d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1515 microversion: 2.1 time: 0.187415 Oct 23 00:09:18.557859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 99/194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:18 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:18.570764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:18.573417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:18.580672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.581173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.582000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.582846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.583359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.583814 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.635795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f136ae04-a5ae-4294-a96e-a235aa7416f3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "POST /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.082427 Oct 23 00:09:18.645263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 96/195] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:09:16 2022] POST /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda/os-volume_attachments => generated 194 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:09:18.673084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'flavor' on Instance uuid 9595d516-aac5-4107-9664-b4c76e761937 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:09:18.817079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0887c138-030c-40d2-8437-b3eb44fe536f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937/action" status: 200 len: 32 microversion: 2.1 time: 0.250887 Oct 23 00:09:18.817970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 100/196] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:09:18 2022] POST /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 00:09:18.831599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:18.832438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:18.839143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.839794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.840698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:18.841807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:18.842264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:18.842684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:19.070039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:19.071197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:19.077564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:19.079739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:19.080616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:19.081974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:19.083100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:19.083918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:19.084682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:19.103476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5f325b0e-b1af-42c9-925f-8e7610af8bde tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.279515 Oct 23 00:09:19.105397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 97/197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:18 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:19.460709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:19.470003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:19.471433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:19.472623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b7699e35-e91b-4c8b-833b-d7aca5223b35 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1598 microversion: 2.20 time: 0.407820 Oct 23 00:09:19.473218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 101/198] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:09:19 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1598 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:09:19.498990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:19.499865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:19.505864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:19.506345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:19.506777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:19.507482 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:19.507973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:19.508415 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:19.589466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4890f27b-6962-4b9f-a3dc-b1f28f2c27a5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094514 Oct 23 00:09:19.590065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 98/199] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 23 00:09:19 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:09:20.127708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:20.128320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:20.134773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:20.135252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:20.136013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:20.136753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:20.137173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:20.137750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:20.648786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:20.684377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-55a9bc99-27c3-42e2-96f9-10d66147e37d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.559478 Oct 23 00:09:20.686120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 102/200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:20 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:21.716743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:21.718144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:21.725522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:21.726265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:21.726958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:21.727983 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:21.728797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:21.729440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:21.986420 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:21.988003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:21.998252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:21.999531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:21.999709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1e87e786-454e-436a-bd8e-0e02b1350a61 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.288221 Oct 23 00:09:22.000193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:22.001043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 99/201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:21 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:22.016042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] Creating event network-changed:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:09:22.018923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-4c052ede-e586-4d56-a6be-38e8287da26a req-fa7dbe26-0cf9-4cb2-bb13-18e17e4f0115 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 Oct 23 00:09:22.020069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 103/202] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:09:23.027911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:23.028668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:23.042421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:23.042974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:23.043742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:23.044976 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:23.045756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:23.048721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:23.332858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:23.349674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-26deb330-d378-4824-ba87-c66a4f159886 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.326374 Oct 23 00:09:23.351059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 100/203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:23 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:24.377496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:24.378993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:24.385843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:24.386321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:24.390137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:24.391304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:24.392173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:24.392754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:24.543487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:24.552933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b26bfda0-ce2c-4e63-9c23-69cd54fa35c6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.181420 Oct 23 00:09:24.553424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 104/204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:24 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:25.576793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:25.578019 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:25.584397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:25.584895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:25.585321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:25.586363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:25.586972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:25.587398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:25.802662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:25.814848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f33db6b6-ef62-4f51-94f1-d94804e2aa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.241974 Oct 23 00:09:25.815619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 101/205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:25 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:26.838825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:26.839990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:26.846947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:26.847430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:26.847864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:26.848576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:26.849183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:26.849762 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:27.013627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:27.021851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-18d2100e-0578-4f11-83a1-3bd868b5d283 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.186733 Oct 23 00:09:27.022727 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 105/206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:26 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:28.047914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:28.048551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:28.054952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:28.055642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:28.056079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:28.057007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:28.057461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:28.058109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:28.221372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:28.240920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-53925216-7d8b-40f3-8edb-059fe94ab0e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.197472 Oct 23 00:09:28.241961 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 102/207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:28 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:29.266312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:29.267523 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:29.273994 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:29.274499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:29.274982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:29.275768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:29.276235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:29.276919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:29.292388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:29.416156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:29.424673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-703560ec-90c9-4064-8873-b5e380c74641 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.162107 Oct 23 00:09:29.425228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 106/208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:29 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:30.447404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:30.448009 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:30.454429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:30.454901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:30.455330 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:30.456010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:30.456460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:30.456904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:30.601418 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:30.613250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-478f7889-89ff-4b2b-aa34-b5d0ebaa3d69 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.169558 Oct 23 00:09:30.624941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 103/209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:30 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:31.639462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:31.640673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:31.642910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=54 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:31.649417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:31.649975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:31.651409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:31.652646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:31.653565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:31.654057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:31.828879 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:31.836718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-02f716b4-7c7b-4068-86a5-467ed325615b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.202228 Oct 23 00:09:31.837273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 107/210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:31 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:31.894729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:31.895620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:31.902258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:31.902734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:31.903159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:31.903851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:31.904297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:31.904737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:31.932728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:09:32.175860 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-651de53e-5c02-4dd2-aecb-cda4a53fab01 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 204 len: 0 microversion: 2.1 time: 0.287223 Oct 23 00:09:32.176431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 104/211] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:09:31 2022] DELETE /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:09:32.184544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:32.185160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:32.191106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:32.191582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:32.192013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:32.192734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:32.193185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:32.193609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:32.332749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:32.340889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0a9c8d94-c33e-496e-b5b1-7084c9e963d3 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.160140 Oct 23 00:09:32.341447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 108/212] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:32 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:09:32.862735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:32.863429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:32.870059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:32.870560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:32.870996 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:32.871689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:32.872177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:32.872629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:33.006664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:33.014804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-872d115a-33e5-4197-aded-95eb2907d9fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.157176 Oct 23 00:09:33.015614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 105/213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:32 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:33.365602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:33.366213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:33.372129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:33.372647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:33.373086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:33.373768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:33.374218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:33.374690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:33.506275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:33.514516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-08f8a047-771f-46a5-95f7-e3544ef75ce5 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.152723 Oct 23 00:09:33.515372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 109/214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:33 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:34.040293 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:34.040947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:34.043442 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:34.050461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:34.051566 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:34.052017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:34.052916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:34.053417 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:34.053882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:34.203494 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:34.213136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2bea8ef0-075e-411a-9af0-2fbd74eeaf00 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.177672 Oct 23 00:09:34.213727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 106/215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:34 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:34.537422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:34.538065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:34.544083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:34.544594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:34.545035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:34.545726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:34.546291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:34.546784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:34.677259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:34.685475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d99311c9-4896-4133-8b80-623e49273842 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.151827 Oct 23 00:09:34.685984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 110/216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:34 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:35.238228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:35.238742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:35.245154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:35.245640 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:35.246072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:35.246753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:35.247204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:35.247625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:35.377125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:35.384910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4147b190-0cd7-4a19-a361-242dae09bf81 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.151174 Oct 23 00:09:35.385547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 107/217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:35 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:35.708261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:35.708895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:35.714749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:35.715224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:35.715652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:35.716322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:35.716809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:35.717229 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:35.853463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:35.861420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9b02c56f-19ff-45e1-877f-0bb193bc9446 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.156979 Oct 23 00:09:35.861984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 111/218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:35 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:36.408450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:36.409488 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:36.417731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:36.418211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:36.418649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:36.419407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:36.419866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:36.420351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:36.549503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:36.557820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-06d2dc94-d025-4e9c-8506-94a97fad2c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.153810 Oct 23 00:09:36.558438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 108/219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:36 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:36.884080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:36.884747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:36.890701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:36.891182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:36.891616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:36.892296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:36.892789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:36.893219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:37.021804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:37.030770 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-345a0535-fdc1-4619-a774-9d505dd01eaf tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.150077 Oct 23 00:09:37.031467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 112/220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:36 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:37.582731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:37.583258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:37.589917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:37.590402 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:37.590837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:37.591538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:37.591989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:37.592414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:37.613716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:37.731782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:37.739700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f0be28ac-8498-4506-86ad-807e4a50bbe2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.161548 Oct 23 00:09:37.740268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 109/221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:37 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:38.054844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:38.055481 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:38.061800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:38.062371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:38.062813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:38.063501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:38.063958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:38.064381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:38.191397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:38.199532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e16856bc-a6c4-46e2-9cfd-cb593e89fcd1 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.148440 Oct 23 00:09:38.200092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 113/222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:38 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:38.766062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:38.766724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:38.773068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:38.773540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:38.773969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:38.774675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:38.775123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:38.775540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:38.906542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:38.914210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-447241cc-9604-44f0-a472-38714648b00c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.152799 Oct 23 00:09:38.914767 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 110/223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:38 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:39.225252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:39.225869 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:39.232272 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:39.232821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:39.233261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:39.234755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:39.235115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:39.235540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:39.380753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:39.391239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7c6cad0e-bc88-42b0-9f66-2f2a87112a87 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.170188 Oct 23 00:09:39.392670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 114/224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:39 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:39.938195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:39.938727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:39.944709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:39.945186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:39.945619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:39.946301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:39.946765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:39.947169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:40.081738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:40.089892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-104bcea8-25e6-48e6-9a98-1c10cbf0580c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.156064 Oct 23 00:09:40.090502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 111/225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:39 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:40.415082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:40.415726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:40.422367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:40.422777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:40.423241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:40.423959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:40.424416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:40.424895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:40.568253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:40.576580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2301edf3-332f-432b-a59a-a2b97562216b tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.165231 Oct 23 00:09:40.577218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 115/226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:40 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:41.113540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:41.115618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:41.124449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:41.125445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:41.126160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:41.127350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:41.128121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:41.128887 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:41.272050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:41.282693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-37e8d245-3df4-4a29-8163-93acf82a3648 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.172145 Oct 23 00:09:41.283671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 112/227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:41 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:41.599917 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:41.600550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:41.606550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:41.607070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:41.607559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:41.608240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:41.608828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:41.609253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:41.740838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:41.749642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-88de9171-3582-4d47-a41f-f05fcd02108e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.152994 Oct 23 00:09:41.750388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 116/228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:41 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:42.306734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:42.307347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:42.314204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:42.314692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:42.315112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:42.315796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:42.316244 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:42.316690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:42.447142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:42.455477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8e4de1ca-801c-417c-99e1-83733572f68e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.152550 Oct 23 00:09:42.456034 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 113/229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:42 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:42.778416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:42.779238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:42.786388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:42.786873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:42.787402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:42.788089 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:42.788563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:42.788983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:42.959796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:42.968699 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-abf41f6e-bb23-436d-93a6-f9546ac2614f tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.198016 Oct 23 00:09:42.969607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 117/230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:42 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:43.479114 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:43.479781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:43.487686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:43.488165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:43.488635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:43.489683 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:43.490148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:43.490579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:43.640349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:43.648069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-af913b8f-281d-41ea-978d-89850eb4f1fb tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.172776 Oct 23 00:09:43.648692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 114/231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:43 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:44.001473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:44.002099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:44.008340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:44.008847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:44.009281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:44.009968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:44.010421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:44.010843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:44.139127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:44.147334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fcca2b0d-a64d-443d-88df-171b767042e6 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.150274 Oct 23 00:09:44.147891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 118/232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:43 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:44.678424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:44.679031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:44.685696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:44.686244 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:44.686715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:44.687598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:44.688058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:44.688491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:44.823951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:44.832270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-23a668c5-6534-4b73-b9cd-9c5daf8b9a35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.157732 Oct 23 00:09:44.832873 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 115/233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:44 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:45.177549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:45.178138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:45.188218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:45.188741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:45.189176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:45.189873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:45.190321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:45.190740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:45.333370 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:45.341529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-40b134cb-a084-45cf-b13d-d78d86118473 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.167814 Oct 23 00:09:45.342095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 119/234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:45 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:45.856178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:45.856811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:45.863738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:45.864216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:45.864697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:45.865378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:45.865831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:45.866252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:45.995608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:46.003277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cefcee6b-b944-4731-8afd-958fc3d46e91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.150971 Oct 23 00:09:46.003840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 116/235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:45 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:46.365301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:46.365824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:46.371728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:46.372203 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:46.372661 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:46.373336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:46.373780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:46.374664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:46.501467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:46.509478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bf6ecba6-6956-4031-957d-54da4007cb33 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.148121 Oct 23 00:09:46.510033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 120/236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:46 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:47.025526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:47.026054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:47.032477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:47.032989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:47.033429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:47.034149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:47.034602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:47.035028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:47.162467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:47.170309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-57810b7b-6012-4349-bea3-f02151fc237f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.148808 Oct 23 00:09:47.171507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 117/237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:47 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:47.534378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:47.535067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:47.541726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:47.542214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:47.542644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:47.543338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:47.543785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:47.544201 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:47.676017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:47.684887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c80a43d0-a38a-4c5c-8598-919dd658dce0 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.155870 Oct 23 00:09:47.685541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 121/238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:47 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:48.193788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:48.194461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:48.201089 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:48.201646 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:48.202689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:48.203671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:48.204205 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:48.204723 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:48.334481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:48.343249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a54ec3a3-f873-4ecb-8963-f55b82d8b87e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.152813 Oct 23 00:09:48.343833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 118/239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:48 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:48.709210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:48.709854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:48.715957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:48.716440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:48.716909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:48.717736 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:48.718224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:48.718655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:48.849783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:48.853251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:48.859648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8c8ffb2b-22af-4a2e-a6d0-01abf122cb5e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.154305 Oct 23 00:09:48.860323 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 122/240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:48 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:49.366790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:49.367318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:49.373668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:49.374751 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:49.375806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:49.376511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:49.376954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:49.377373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:49.507234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:49.514910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-541446d9-ca98-45e0-a530-8fa5659473ad tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.152096 Oct 23 00:09:49.515473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 119/241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:49 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:49.889716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:49.891570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:49.899840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:49.900439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:49.901962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:49.902951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:49.903610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:49.904243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:49.931765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd9f246-af01-42f2-874c-e96df43a5eda", "name": "network-vif-unplugged", "status": "completed", "tag": "ec7ae329-daa1-4671-ae98-43e3fdce1560"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:49.941748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:49.942301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:49.957200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:49.975127 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] Creating event network-vif-unplugged:ec7ae329-daa1-4671-ae98-43e3fdce1560 for instance ffd9f246-af01-42f2-874c-e96df43a5eda on hv-cinder-86156 Oct 23 00:09:49.985432 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-144b684a-6236-495f-a955-80b329ee34e9 req-a16be5cf-d574-43b2-9d1c-7e6124a13626 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056982 Oct 23 00:09:49.986670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 120/242] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:09:50.068594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:50.076843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-212a2e00-ae63-42ff-b64b-12940fd0fbd4 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1553 microversion: 2.1 time: 0.196795 Oct 23 00:09:50.077969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 123/243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:49 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:50.538736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:50.539531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:50.546771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:50.547370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:50.547813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:50.548615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:50.549077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:50.549504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:50.660040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd9f246-af01-42f2-874c-e96df43a5eda", "name": "network-vif-deleted", "tag": "ec7ae329-daa1-4671-ae98-43e3fdce1560"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:09:50.675017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:50.675017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:50.675453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:50.688194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] Creating event network-vif-deleted:ec7ae329-daa1-4671-ae98-43e3fdce1560 for instance ffd9f246-af01-42f2-874c-e96df43a5eda on hv-cinder-86156 Oct 23 00:09:50.691562 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:50.693559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-37f2e924-04a5-4363-ad1d-d3fa7713b3d0 req-6fd72389-a0e2-4cf6-96e7-70ccea79d11c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Oct 23 00:09:50.694457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 124/244] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:09:50.703641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-eef40d60-7f1c-4cd4-b880-d33e5ccc16fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.169192 Oct 23 00:09:50.704422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 121/245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:50 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:51.106985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:51.106985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:51.115091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:51.115584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:51.116019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:51.116753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:51.117213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:51.117630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:51.181466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:51.190141 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8bd46411-1cb2-48ed-a45e-475e0dbefd83 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1344 microversion: 2.1 time: 0.090192 Oct 23 00:09:51.190710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 125/246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:51 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:51.729724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:51.730319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:51.737687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:51.738170 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:51.738607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:51.739408 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:51.740005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:51.740779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:51.878347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:51.886196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a274bcb9-3e44-4017-a1b8-8a2a1bb2421e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.160572 Oct 23 00:09:51.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 122/247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:51 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:52.219154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:52.220705 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:52.228120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:52.228667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:52.229101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:52.229798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:52.230265 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:52.230738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:52.263962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:52.264442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:52.265563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:52.266007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lazy-loading 'fault' on Instance uuid ffd9f246-af01-42f2-874c-e96df43a5eda {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:09:52.309666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127eff42dfb141c3b78ce04636af1f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06566ec2efab47ea80f2f10723b478a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:52.318592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9fd9c0aa-955d-4d56-8a76-8103afdfe42a tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 200 len: 1349 microversion: 2.1 time: 0.108839 Oct 23 00:09:52.319168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 126/248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:52 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:52.911598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:52.912516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:52.919413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:52.920103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:52.920692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:52.922707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:52.923168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:52.923598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:53.054520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:53.063792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-64b154a9-359a-491f-89ef-16097e336ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.157324 Oct 23 00:09:53.064366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 123/249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:52 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:53.342454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:53.344889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:53.351743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:53.352390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:53.353106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:53.353798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:53.354401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:53.354996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:53.369336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] HTTP exception thrown: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Request method failure captured: Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda HTTP/1.1 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXjdIdvzzkflLxXLqnYWTm17lVy83i8L_Rkpt-QP_wLDTRxgnSv2PU9lHCeCbJkgg2Y_WwAMFjYat61HJG8gK7Ut-SCxUOWZDDi5p7guiT_JQH8vI1zLaiFRjdYCgcLnmVhkIYK39IADgsAxFuwWVGWYA6EwkR_3VFnR-OK4JHojY0 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:09:53.374568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06566ec2efab47ea80f2f10723b478a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 127eff42dfb141c3b78ce04636af1f28 Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.375896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': 'ffd9f246-af01-42f2-874c-e96df43a5eda'} Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:09:53.376608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.377748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.380097 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Returning 404 to user: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:09:53.381740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c6620bfb-e4cd-445e-a0e0-884f6635f054 tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 404 len: 111 microversion: 2.1 time: 0.043157 Oct 23 00:09:53.382445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 127/250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:53 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:09:53.517460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:53.520520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:53.526784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:53.527271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:53.527708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:53.528649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:53.529440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:53.530068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:53.544109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] HTTP exception thrown: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Request method failure captured: Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda/os-volume_attachments HTTP/1.1 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXjdIdvzzkflLxXLqnYWTm17lVy83i8L_Rkpt-QP_wLDTRxgnSv2PU9lHCeCbJkgg2Y_WwAMFjYat61HJG8gK7Ut-SCxUOWZDDi5p7guiT_JQH8vI1zLaiFRjdYCgcLnmVhkIYK39IADgsAxFuwWVGWYA6EwkR_3VFnR-OK4JHojY0 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:09:53.548986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06566ec2efab47ea80f2f10723b478a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 127eff42dfb141c3b78ce04636af1f28 Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.550172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'server_id': 'ffd9f246-af01-42f2-874c-e96df43a5eda'} Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:09:53.550834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:53.551906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:53.553035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Returning 404 to user: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:09:53.553035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3d2cbae7-6df5-4a15-8f30-677a0f0f046e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037956 Oct 23 00:09:53.553035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 124/251] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:09:53 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:09:54.089298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:54.090516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:54.097669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.098462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.098920 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.099604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.100210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.100677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.289775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:54.301983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cc778b25-3cd2-4682-b243-2a516fc049d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.217691 Oct 23 00:09:54.302865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 128/252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:54 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:54.817704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:54.819925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:54.832086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.832853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.833509 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.834460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.835134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.835782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.861911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] HTTP exception thrown: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Request method failure captured: Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda HTTP/1.1 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXjdIdvzzkflLxXLqnYWTm17lVy83i8L_Rkpt-QP_wLDTRxgnSv2PU9lHCeCbJkgg2Y_WwAMFjYat61HJG8gK7Ut-SCxUOWZDDi5p7guiT_JQH8vI1zLaiFRjdYCgcLnmVhkIYK39IADgsAxFuwWVGWYA6EwkR_3VFnR-OK4JHojY0 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:09:54.865393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06566ec2efab47ea80f2f10723b478a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 127eff42dfb141c3b78ce04636af1f28 Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.866802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'ffd9f246-af01-42f2-874c-e96df43a5eda'} Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:09:54.867681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.869121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.870411 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Returning 404 to user: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:09:54.871225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-151b9467-5b86-4867-b3ca-e23bb3413eab tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 404 len: 111 microversion: 2.1 time: 0.057884 Oct 23 00:09:54.873030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 125/253] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:09:54 2022] DELETE /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:09:54.881710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:54.882422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] [instance: ffd9f246-af01-42f2-874c-e96df43a5eda] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:54.888432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.889336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.890512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.891501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:54.892166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:54.893229 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:54.911850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] HTTP exception thrown: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Request method failure captured: Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda HTTP/1.1 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXjdIdvzzkflLxXLqnYWTm17lVy83i8L_Rkpt-QP_wLDTRxgnSv2PU9lHCeCbJkgg2Y_WwAMFjYat61HJG8gK7Ut-SCxUOWZDDi5p7guiT_JQH8vI1zLaiFRjdYCgcLnmVhkIYK39IADgsAxFuwWVGWYA6EwkR_3VFnR-OK4JHojY0 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:09:54.914571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06566ec2efab47ea80f2f10723b478a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06566ec2efab47ea80f2f10723b478a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 06566ec2efab47ea80f2f10723b478a5 Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-DeleteServersTestJSON-628217503 Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 127eff42dfb141c3b78ce04636af1f28 Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-DeleteServersTestJSON-628217503-project Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.915873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': 'ffd9f246-af01-42f2-874c-e96df43a5eda'} Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:09:54.916566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. Oct 23 00:09:54.918378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:09:54.921829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] Returning 404 to user: Instance ffd9f246-af01-42f2-874c-e96df43a5eda could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:09:54.921829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a57de52f-e9a0-453a-8786-c9cd3efed98e tempest-DeleteServersTestJSON-628217503 tempest-DeleteServersTestJSON-628217503-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda" status: 404 len: 111 microversion: 2.1 time: 0.039015 Oct 23 00:09:54.921829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 129/254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:54 2022] GET /compute/v2.1/servers/ffd9f246-af01-42f2-874c-e96df43a5eda => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:09:55.331790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:55.332434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:55.340246 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:55.340397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:55.340852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:55.351423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:55.351423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:55.351423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:55.556013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:55.567376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dd1db850-30ce-4c7c-9ebb-72c78cd553ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.240718 Oct 23 00:09:55.568214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 126/255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:55 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:56.598485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:56.599865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:56.608401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:56.610893 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:56.612717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:56.613761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:56.614610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:56.615803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:56.994837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:57.003638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a1944a87-f400-41f2-bf4e-3cfc1bea8c9b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.413168 Oct 23 00:09:57.038506 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 130/256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:56 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:58.029697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:58.030315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:58.046951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:58.047502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:58.047930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:58.055133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:58.055633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:58.056079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:58.459759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:58.473807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-12369b20-1dfd-4bc2-9e3c-9f82f8bbd8b9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.443643 Oct 23 00:09:58.476942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 127/257] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:58 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:09:59.502791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:09:59.503883 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:09:59.512690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:59.514655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:59.519147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:59.521365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:09:59.522627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:09:59.523755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:09:59.744438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:09:59.755723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2b7e08e7-5b99-4d0b-8e76-398344916093 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.261238 Oct 23 00:09:59.757064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 131/258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:09:59 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:00.155082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1831905201", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "networks": [{"uuid": "61d93521-8718-4076-be2f-51df1dfb85c0"}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:00.240361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] validate_networks() for [('61d93521-8718-4076-be2f-51df1dfb85c0', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:10:00.783059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:00.785101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:00.797147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:00.797678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:00.798116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:00.798828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:00.799305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:00.799731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:01.273917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:10:01.275000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:10:01.275957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:10:01.276552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:10:01.277401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:10:01.293602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:01.302832 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-92c751e4-3d26-4e82-99f8-13e295c16173 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.525175 Oct 23 00:10:01.303243 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:01.303737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:01.304172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:01.304925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:01.305381 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:01.305808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:01.311090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 132/259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:00 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:01.332799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:01.347293 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Getting quotas for project bcef7335dafe4b29960c12ce5ab5330b. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:01.352440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Getting quotas for user 63286ecd4376471f8ab5f647674eaf43 and project bcef7335dafe4b29960c12ce5ab5330b. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:01.373910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:10:01.378338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:10:01.462161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d2e82c57-43bc-404b-b0a2-aea0b7354ec7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311597 Oct 23 00:10:01.463168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 128/260] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:10:01.476011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-98756b51-5de3-4665-a949-25fff41dd324 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:01.477108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-98756b51-5de3-4665-a949-25fff41dd324 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:01.553734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-98756b51-5de3-4665-a949-25fff41dd324 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:01.563449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-98756b51-5de3-4665-a949-25fff41dd324 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1214 microversion: 2.1 time: 0.091538 Oct 23 00:10:01.584788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 133/261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:01 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:02.336263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:02.338035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:02.349007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:02.352549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:02.353176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:02.356835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:02.357554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:02.358062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:02.597979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:02.598908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:02.609750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=58 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:02.613765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:02.614267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:02.614710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:02.615423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:02.615889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:02.616314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:02.689116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:02.704436 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3fd75a87-7c69-4750-9bad-877b37831e63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.372389 Oct 23 00:10:02.706961 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 129/262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:02 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:02.748257 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:02.761414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-86ce162c-e159-46f2-9e57-b275f4da2f78 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1266 microversion: 2.1 time: 0.168233 Oct 23 00:10:02.762466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 134/263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:02 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:03.739864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:03.741349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:03.754696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:03.756061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:03.757609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:03.759470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:03.760462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:03.761637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:03.787413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:03.788025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:03.799730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:03.800235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:03.800695 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:03.801585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:03.802189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:03.802760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:04.009507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:04.019107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5e84fa0d-58c6-40c8-b52e-053508d2c670 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1272 microversion: 2.1 time: 0.236123 Oct 23 00:10:04.043061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 135/264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:03 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:04.234165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:04.249171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d14cbbf5-7732-49b1-a0e4-d4d9b4b62970 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.523847 Oct 23 00:10:04.268897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 130/265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:03 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:05.048783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:05.049410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:05.058967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:05.059720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:05.060590 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:05.061557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:05.062859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:05.063677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:05.271672 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:05.272264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:05.274703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:05.282005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:05.282640 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:05.283113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:05.291824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:05.292375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:05.293056 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:05.411909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:05.442404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ebdef625-fc92-43b0-9b37-698fad227d99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.397528 Oct 23 00:10:05.443008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 136/266] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:05 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:05.659783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:05.669430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-356ed69e-d327-4727-beb8-623af902c7f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.401556 Oct 23 00:10:05.675445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 131/267] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:05 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:06.487274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:06.487896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:06.502929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:06.529152 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:06.530180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:06.533656 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:06.534982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:06.538018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:06.696072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:06.696717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:06.712253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:06.715809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:06.716452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:06.720652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:06.721929 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:06.722554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:07.161060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:07.180371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7207fa59-2096-4ea6-9f64-991ba742d204 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.713355 Oct 23 00:10:07.181949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 137/268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:06 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:07.373385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:07.389492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ab96a2b6-a03e-41af-8916-2aca74eecbc3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 0.697481 Oct 23 00:10:07.391308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 132/269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:06 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:08.205992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:08.206735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:08.221625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:08.222114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:08.222540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:08.231032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:08.232963 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:08.233625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:08.419286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:08.419938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:08.432063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:08.432584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:08.433052 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:08.440608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:08.445824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:08.446592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:09.830819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:09.840447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-33c2e566-1fec-4200-84ed-54304f5612a7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1521 microversion: 2.1 time: 1.426583 Oct 23 00:10:09.848684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:09.850304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 133/270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:08 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1521 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:09.856555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d022d3f-9f5d-4d1d-b7e5-64c8df6da013", "tag": "22c4f251-4487-4173-ba8e-fbaf35eb5e14"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:09.883324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-abebf371-c5ef-4598-8aa8-68f8eb328ccc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 1.682448 Oct 23 00:10:09.883666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:09.884285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:09.884867 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:09.886066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 138/271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:08 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:09.932814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] Creating event network-changed:22c4f251-4487-4173-ba8e-fbaf35eb5e14 for instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 on hv-cinder-86156 Oct 23 00:10:09.938722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-4905912d-bad7-4404-a2a6-fd99efd9f445 req-54727d36-234e-413c-84ee-e53fe7048472 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086990 Oct 23 00:10:09.939336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 134/272] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:10.883618 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:10.884807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:10.901681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:10.903924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:10.904974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:10.906764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:10.908995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:10.910426 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:10.913594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:10.914305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:10.924158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:10.924766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:10.925286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:10.926012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:10.926466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:10.926894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:11.333133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:11.362338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:11.490101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:11.499991 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-87e1f06f-73a3-4302-98a1-054cda79d9aa tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.590335 Oct 23 00:10:11.503521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 135/273] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:10 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:11.525754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:11.545633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9f1c9f1a-1a2d-4232-86ce-1c3e838241e0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1501 microversion: 2.1 time: 0.669748 Oct 23 00:10:11.554521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 139/274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:10 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1501 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:11.579063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:11.579364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:11.598373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:11.598917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:11.599498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:11.600216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:11.600717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:11.601139 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:12.304352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:12.316558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0e0667d0-9537-4f7f-96f5-5277eae99638 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1515 microversion: 2.1 time: 0.741678 Oct 23 00:10:12.339375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 136/275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:11 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1515 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:12.545095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:12.548735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:12.598042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:12.612127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:12.614595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:12.618226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:12.626541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:12.629984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:12.632321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:13.693833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:13.712767 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9d984358-3d06-4daf-a34c-1d0f03d39dd8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 1.187141 Oct 23 00:10:13.714234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 140/276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:12 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:14.741794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:14.742855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:14.760529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:14.761038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:14.761934 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:14.771653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:14.775135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:14.775783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:15.130783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:15.151169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2c1ccba1-2c09-4308-89d7-3371308e0a71 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.412600 Oct 23 00:10:15.154374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 137/277] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:14 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:15.507866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:15.518634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:15.541126 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:15.542997 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:15.545149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:15.549058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:15.550943 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:15.551465 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:15.644583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6c5b5f85-6dc0-43a8-bea7-e07178686862 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: .version_select at 0x7f3f8da0e670>, body: {"keypair": {"name": "tempest-keypair-1140853283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ7s5Mk7BRJpGXd08gB7i8udqRvWxrpM73ldimALgF9bnLytTqRyraSxumXvqiFiMS3k4DJ8JMnMNEJHqe8FDgjSFDEQL36vpQGuRC2RSnTw+YsKp198JnjSUDljM9mEw=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:15.670413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'flavor' on Instance uuid c788f89c-5620-4a79-aca6-4b2dce29abc0 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:10:15.711663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-6c5b5f85-6dc0-43a8-bea7-e07178686862 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:15.728299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-6c5b5f85-6dc0-43a8-bea7-e07178686862 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for user f0cf683aa4d14dea974f0febffbbeacc and project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:15.782890 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6c5b5f85-6dc0-43a8-bea7-e07178686862 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.437622 Oct 23 00:10:15.783990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 141/278] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:10:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:15.986391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-70d4f092-1dd8-40b6-9042-8c7a29be77ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/action" status: 200 len: 32 microversion: 2.1 time: 0.498151 Oct 23 00:10:15.992794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 138/279] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:10:15 2022] POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/action => generated 32 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:10:16.003267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:16.004005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:16.017137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:16.017727 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:16.018406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:16.019349 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:16.022311 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:16.023454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:16.194376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:16.198938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:16.209801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:16.210875 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:16.211570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:16.212527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:16.213208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:16.213821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:16.633014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:16.653219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8922fef2-1c8f-405c-855e-66270deb20a5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.653168 Oct 23 00:10:16.664224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 142/280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:15 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:16.794885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:16.820152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f38ee881-32b8-4a86-8a36-c44cd3b68585 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.639885 Oct 23 00:10:16.829608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 139/281] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:16 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:17.681003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:17.682283 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:17.691307 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:17.699287 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:17.699967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:17.700920 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:17.701526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:17.702104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:17.707243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:17.860121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:17.860775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:17.879632 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:17.880935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:17.881647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:17.882620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:17.884692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:17.885311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:18.670587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:18.684791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-eb0c60ce-7405-470d-b5bb-53f105ed9f39 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 1.008994 Oct 23 00:10:18.686437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 143/282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:17 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:18.705478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1909183244", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "networks": [{"uuid": "14b8a3cd-59bd-42ce-aece-f552f98dac26"}]}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:18.882728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] validate_networks() for [('14b8a3cd-59bd-42ce-aece-f552f98dac26', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:10:19.084407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:19.098152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b2bab91a-7621-4aff-9aec-3d460a883439 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 1.242485 Oct 23 00:10:19.100133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 140/283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:17 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:19.720832 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:19.721723 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:19.733579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:19.736357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:19.737111 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:19.738082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:19.738951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:19.739668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:20.215122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:20.223658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-90ff1dc7-a480-45ca-ae59-4b5328190752 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.512286 Oct 23 00:10:20.224234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 141/284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:19 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:20.244752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:20.245726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:20.252533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:20.253296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:20.253900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:20.254790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:20.255461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:20.256054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:20.838707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:20.848749 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-77df4d34-3a26-4eb3-aa49-5f88c5fc26f8 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.618056 Oct 23 00:10:20.853778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 142/285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:20 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:21.137816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:10:21.141242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:10:21.141928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:10:21.143401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:10:21.145731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:10:21.168144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.168925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.169375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.170134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.170568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.171522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.192675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Getting quotas for project a199c36a2f054a03ae399ace011c3c95. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:21.198161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Getting quotas for user 0675f7444e544220b53a34dd3086edc5 and project a199c36a2f054a03ae399ace011c3c95. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:21.212056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:10:21.215059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:10:21.255534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:21.256445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:21.272081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.272908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.273447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.275400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.276575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.281929 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.299716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4a7e0c86-4f88-4746-8446-a9fc6454497f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611760 Oct 23 00:10:21.301786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 144/286] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:10:21.314076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f3c885bd-ba82-40fb-8256-5bf993cf5ece tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:21.315151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f3c885bd-ba82-40fb-8256-5bf993cf5ece tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:21.428526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f3c885bd-ba82-40fb-8256-5bf993cf5ece tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:21.438413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f3c885bd-ba82-40fb-8256-5bf993cf5ece tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1219 microversion: 2.1 time: 0.129596 Oct 23 00:10:21.439016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 145/287] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:21 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:21.474851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-445357436", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac5050ac-e38f-4a12-be5a-6131b2b8d4d4"}], "security_groups": [{"name": "tempest-securitygroup--1589259458"}], "key_name": "tempest-keypair-1140853283", "user_data": "}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:21.616926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:21.631603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-983ad0ba-9fbe-4cbd-9db6-7aae25984469 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.388214 Oct 23 00:10:21.646303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 143/288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:21 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:21.771385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] validate_networks() for [('ac5050ac-e38f-4a12-be5a-6131b2b8d4d4', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:10:21.876740 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:21.877370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:21.887630 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.891222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.891782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.892547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:21.893014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:21.893449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:21.910859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:22.491626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:22.499808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3426e9e2-75fc-4a64-8160-46c6134eba6a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.626887 Oct 23 00:10:22.500900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 144/289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:21 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:22.511534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d022d3f-9f5d-4d1d-b7e5-64c8df6da013", "name": "network-vif-plugged", "status": "completed", "tag": "22c4f251-4487-4173-ba8e-fbaf35eb5e14"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:22.524819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:22.525443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:22.526099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:22.540699 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] Creating event network-vif-plugged:22c4f251-4487-4173-ba8e-fbaf35eb5e14 for instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 on hv-cinder-86156 Oct 23 00:10:22.549520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-43705830-7e93-4019-9520-a85f9e9b3935 req-f7c29845-bb7d-42c9-bd69-7e2acc7ad77d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046427 Oct 23 00:10:22.550158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 145/290] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:22.555883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:22.556622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:22.566885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:22.567392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:22.568130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:22.568784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:22.569412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:22.569786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:22.695816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:22.704370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-65b9cff4-50e8-48dd-a177-23987cbed1b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1223 microversion: 2.1 time: 0.152783 Oct 23 00:10:22.705171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 146/291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:22 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:22.725699 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:22.726304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:22.732344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:22.732853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:22.733286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:22.734676 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:22.735134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:22.735559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.034645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:10:23.035131 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:10:23.035685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:10:23.036093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:10:23.036522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:10:23.045660 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.046662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:23.047524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.048226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.049717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.050649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.051393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.054990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-eb759e8a-756f-43eb-9a82-80ca8b9f75f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.332976 Oct 23 00:10:23.055579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:22 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:23.072281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:23.076988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for user f0cf683aa4d14dea974f0febffbbeacc and project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:23.091591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:10:23.094043 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:10:23.151235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a845b728-3601-4712-b0de-dda76856f3b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.692346 Oct 23 00:10:23.151895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 146/293] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:10:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:10:23.168911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-590cf589-3c88-4110-a5b7-428b39aba881 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:23.169987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-590cf589-3c88-4110-a5b7-428b39aba881 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:23.287421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-590cf589-3c88-4110-a5b7-428b39aba881 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:23.296356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-590cf589-3c88-4110-a5b7-428b39aba881 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1237 microversion: 2.1 time: 0.136640 Oct 23 00:10:23.301213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 148/294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:23 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:23.526901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:23.527709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:23.544112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.544637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.545081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.545799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.546351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.547502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.728180 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:23.730532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:23.741982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.743780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.745867 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.746775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:23.749001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:23.750313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:23.901312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:23.910827 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e999acc6-34da-4943-b304-fea42697acdc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1223 microversion: 2.1 time: 0.186913 Oct 23 00:10:23.912405 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 149/295] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:23 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:23.953385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:23.963519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3244e30e-d241-492a-9359-845032ff86d2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.441690 Oct 23 00:10:23.967711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 147/296] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:23 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:24.081409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:24.082496 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:24.088796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.089434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.090108 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.090820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.091278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.091741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.237448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:24.247694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4c21af3d-7317-43a0-ae72-30abfecded8d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.171674 Oct 23 00:10:24.248879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 150/297] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:24 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:24.325253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:24.326510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:24.341306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.342515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.344541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.345300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.346242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.346709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.427378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:24.435995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-423896ab-94f5-45d8-8701-a62a484219cd tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1241 microversion: 2.1 time: 0.116030 Oct 23 00:10:24.436589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 148/298] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:24 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:24.953531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:24.955001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:24.972973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.973318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.973766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.974495 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:24.974953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:24.975390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:24.991298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:24.991912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:25.009278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.010036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.010648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.011376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.011840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.012268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.117183 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:25.130671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5aed7099-4b12-44d0-86db-63bc0bf6c94e tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1223 microversion: 2.1 time: 0.187758 Oct 23 00:10:25.131283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 151/299] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:24 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:25.256527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:25.265168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cd050fea-5086-4cf0-946c-98148661fa31 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.277256 Oct 23 00:10:25.271212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:25.272100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:25.278002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 149/300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:24 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:25.281713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.282516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.283147 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.284037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.284690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.285299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.465138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:25.465744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:25.474178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.474780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.478112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.480643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:25.485142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:25.485794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:25.587985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:25.597473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a867896e-18af-4a1d-b999-5aadde6ddfc5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.329980 Oct 23 00:10:25.600058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 152/301] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:25 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:25.614329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:25.623460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-66a5d730-e45c-457c-a169-72e8346c5654 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1241 microversion: 2.1 time: 0.163921 Oct 23 00:10:25.625053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 150/302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:25 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:26.157080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:26.157700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:26.165877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.170297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.171672 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.173672 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.175956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.176651 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.263136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:26.274853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e5f1763a-2517-4672-94a1-2dfc2eb4c9e3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1223 microversion: 2.1 time: 0.123734 Oct 23 00:10:26.276185 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 153/303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:26 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:26.310415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:26.311382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:26.321385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.335760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.336791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.337787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.338461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.339033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.576995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:26.588663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d1c0fda8-3f6b-4505-900a-4cb1cf5fdcf4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.282590 Oct 23 00:10:26.589505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 151/304] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:26 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:26.628263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:26.629031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:26.636568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.637429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.638116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.639124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.639905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.640877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.662300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:26.663019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:26.669382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.675501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.676314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.677420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:26.678058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:26.678897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:26.778642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:26.787902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ce9e7630-4d8c-4cad-9450-bea0cb8edd85 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1241 microversion: 2.1 time: 0.136515 Oct 23 00:10:26.801013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 152/305] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:26 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:26.844364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:26.857345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a8292852-bbd4-4de7-b10c-208b6fff6ae8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.233803 Oct 23 00:10:26.857967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 154/306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:26 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:27.302560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:27.303798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:27.313415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.314898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.315496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.316475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.317815 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.318454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.420143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:27.436067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f3d1730f-f081-4ff1-b76b-df37a16f74cc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1223 microversion: 2.1 time: 0.141052 Oct 23 00:10:27.441733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 153/307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:27 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:27.638658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:27.640052 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:27.656959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.660023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.660746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.661628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.663960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.664597 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.813538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:27.814828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:27.824415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.825052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.825741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.829191 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.829826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.840524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.918305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:27.934311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fd9ef534-750d-4a62-83b6-49ab306c3b16 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.316172 Oct 23 00:10:27.951527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 155/308] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:27 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:27.958247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:27.959090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:27.961859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:27.966913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.967637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.969087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.970188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:27.971070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:27.971862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:27.973457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d3141a14-6a6a-43eb-a921-e7cdfc884e01 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1241 microversion: 2.1 time: 0.164521 Oct 23 00:10:27.974485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 154/309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:27 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:28.346217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:28.353974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-66f8a206-11db-44e4-a372-32cff0d1bb3a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.398512 Oct 23 00:10:28.354982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 156/310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:27 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:28.466494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:28.467255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:28.481044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:28.481589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:28.482200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:28.492712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:28.494004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:28.494790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:28.580272 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:28.590877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9272ea36-5762-45b8-9cbd-a0ba4d936ff1 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1271 microversion: 2.1 time: 0.130190 Oct 23 00:10:28.591455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 155/311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:28 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:28.958433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:28.959028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:28.967328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:28.968754 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:28.969375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:28.973851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:28.974588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:28.975084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.003145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:29.004315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:29.020037 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.021280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.021912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.022781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.025126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.025513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.162443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:29.170509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-07a2ae79-32ce-4bf0-a6e6-0b08a4ede57b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1233 microversion: 2.1 time: 0.174744 Oct 23 00:10:29.178930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 156/312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:28 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1233 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:29.241104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:29.255962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-260bc077-e06c-47d7-899e-2122d36498d0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.301320 Oct 23 00:10:29.264593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 157/313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:28 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:29.404876 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:29.407209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:29.418084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.418720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.423731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.427377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.428263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.429726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.617055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:29.618174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:29.633622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.639613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.642029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.643849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:29.645636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:29.647466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:29.664138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:29.683028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7c4a7b44-d780-4e02-87d5-4e78f1082c2c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.278899 Oct 23 00:10:29.695496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 157/314] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:29 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:29.775438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:29.789663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6199fd21-ea6c-4be8-9de7-e2151d09e611 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1271 microversion: 2.1 time: 0.177910 Oct 23 00:10:29.792510 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 158/315] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:29 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:30.205161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:30.206521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:30.230058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.232411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.236603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.238086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.239817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.241168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.279537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:30.280137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:30.291629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.294674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.295337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.298074 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.301101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.301942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.386343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:30.396794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bd4ed4b8-fc95-4687-ba35-3bf7af174849 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1233 microversion: 2.1 time: 0.197773 Oct 23 00:10:30.408254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:30 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1233 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:30.552270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:30.567332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3546c8d1-fe69-4559-8b0f-8ae57b01e852 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1314 microversion: 2.1 time: 0.291592 Oct 23 00:10:30.569103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 159/317] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:30 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:30.725648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:30.726690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:30.742924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.743600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.744281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.745343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.746052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.746711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.815289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:30.816477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:30.829394 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.830225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.830831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.833308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:30.833956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:30.836839 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:30.997679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:31.006681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a2210ec7-3868-4897-b321-08504330abae tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1289 microversion: 2.1 time: 0.195443 Oct 23 00:10:31.011694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 160/318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:30 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1289 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:31.192989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:31.210147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e722b04e-94b5-496b-b736-fae44f6e6705 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.491754 Oct 23 00:10:31.211754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 159/319] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:30 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:31.429846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:31.431234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:31.445454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:31.447926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:31.449708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:31.454301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:31.457612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:31.458057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:31.584384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:31.604277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:31.606765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:31.630189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0fd1d01a-62cd-44f7-8fa0-91ebe0c80567 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1289 microversion: 2.1 time: 0.205708 Oct 23 00:10:31.639540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:31.641431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 161/320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:31 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1289 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:31.642565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:31.643316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:31.647162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:31.648533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:31.649193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.039262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:32.041649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:32.059354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.062759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.070669 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.074184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.076033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.077857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.148779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:32.158935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:32.170606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-79739e64-8931-4d2e-929e-68475ab8450e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1498 microversion: 2.1 time: 0.583349 Oct 23 00:10:32.173970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 160/321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:31 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:32.251840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:32.253933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:32.283337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.285853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.287623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.289616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.290193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.291885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.873539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:32.883276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c62e6863-0953-4fa9-ac25-0eb00542af1b tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.847789 Oct 23 00:10:32.907273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 162/322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:32 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:32.931004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:32.931699 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:32.957386 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.957386 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.957681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.958308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:32.958753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:32.964307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:32.979677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:32.992735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c649c3da-1252-4c8a-85d1-ddae12fe6817 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.753075 Oct 23 00:10:32.993845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 161/323] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:32 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:33.021083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:33.022193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:33.041047 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.047432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.054790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.056090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:33.058633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.059135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.059961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:33.066454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=4 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.079086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.124001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=18 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.142194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:10:33.192647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:33.216826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-15d1be5d-d162-4aac-8de0-aa280b5a0442 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1295 microversion: 2.1 time: 0.302058 Oct 23 00:10:33.218213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:32 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1295 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:33.464712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-27adaa58-ad7b-4614-b962-f85736bec2f1 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 204 len: 0 microversion: 2.1 time: 0.453888 Oct 23 00:10:33.467000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:10:33 2022] DELETE /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:10:33.477109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:33.478307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:33.480316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.493529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.495671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.496293 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:33.497208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.497818 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.498417 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:33.852325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:33.883781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f8d164bf-a963-45b4-a842-c9aa0fddc9c7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1504 microversion: 2.1 time: 0.411435 Oct 23 00:10:33.896825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 164/326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:33 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:33.918106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:33.918935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:33.928296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.929095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.929854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:33.930820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:33.931535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:33.932228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.023590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:34.024654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:34.032880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.034078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.034706 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.035592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.036205 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.037339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.334441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:34.372730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-33c1c512-5244-49c2-a558-7fed916142d3 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.442981 Oct 23 00:10:34.374093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 163/327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:33 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:34.379226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:34.380809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:34.387135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.387816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.388425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.389340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.390485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.391068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.393342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:34.405005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e1068956-18bf-42e1-a397-cbf1f981d9c7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.386349 Oct 23 00:10:34.405005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 165/328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:34 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:34.642841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:34.664862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c968cbb1-feca-400c-aef1-7c43abfecccb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.289149 Oct 23 00:10:34.666053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 164/329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:34 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:34.909189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:34.910227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:34.922612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.925206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.925993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:34.928529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:34.929068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:34.929573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:35.031945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c513ed3-7e00-4e46-be58-572838fb4eae", "tag": "6a22a4da-def7-49ce-bbfb-af423b29e223"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:35.074810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:35.077676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:35.079207 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:35.144016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] Creating event network-changed:6a22a4da-def7-49ce-bbfb-af423b29e223 for instance 5c513ed3-7e00-4e46-be58-572838fb4eae on hv-cinder-86156 Oct 23 00:10:35.162579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-d3ffb939-9402-46b6-8500-86db1aad5bc9 req-2d153d6a-d573-4cf2-8fb5-ff180d640a80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136004 Oct 23 00:10:35.163464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 165/330] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:35.324791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:35.339077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c11a6e57-9b47-4498-85b4-e187bdae196e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1504 microversion: 2.1 time: 0.436419 Oct 23 00:10:35.340273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 166/331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:34 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:35.403347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:35.406012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:35.414435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:35.417545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:35.420965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:35.422718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:35.425513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:35.427942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:35.429318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:35.433390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:35.439410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=74 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:35.448992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:35.450642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:35.456990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:35.461270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:35.462164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:35.465413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:36.233110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:36.243607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-02fc6cea-56b9-41d8-8825-21068bd93715 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.848234 Oct 23 00:10:36.250273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:35 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:36.256075 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:36.256723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:36.270424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:36.275823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:36.276722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:36.277331 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:36.281296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:36.282073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:36.282688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:36.292209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-27ebbc66-fe67-41b7-b4b8-fb1fda8102ed tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.866892 Oct 23 00:10:36.295292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:35 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:36.313758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b12f6d-d6e5-426e-8f87-6ce5c17f67f0", "tag": "a78d73f6-5ef9-4c17-87ef-1ebb3a307639"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:36.333975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:36.335425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:36.336096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:36.357590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] Creating event network-changed:a78d73f6-5ef9-4c17-87ef-1ebb3a307639 for instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 on hv-cinder-86156 Oct 23 00:10:36.368890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-7dce9270-d4be-4156-8c17-40dfd1282160 req-3c8106c6-7004-4fb7-93b5-49b913a8249a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071747 Oct 23 00:10:36.370659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 168/334] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:36.378748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:36.379973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:36.389132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:36.390769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:36.391540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:36.392532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:36.393487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:36.394122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.013759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:37.035682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d4a8a779-6644-423b-a362-28f753843c2a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.783820 Oct 23 00:10:37.038021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 167/335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:36 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:37.076605 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:37.114565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8bb52a12-af84-43c8-874f-e6838672b16d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1504 microversion: 2.1 time: 0.742154 Oct 23 00:10:37.115209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:36 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1504 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:37.274226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:37.274809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:37.291017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:37.292468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:37.298185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.308577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:37.310728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:37.311353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.323682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:37.325132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:37.360954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:37.362066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:37.362768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.363968 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:37.364678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:37.366948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.709747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:37.730156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3f589bf2-6de7-4f15-b276-7b4dc8ab9647 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.460396 Oct 23 00:10:37.739244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 168/337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:37 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:37.745805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d022d3f-9f5d-4d1d-b7e5-64c8df6da013", "name": "network-vif-deleted", "tag": "22c4f251-4487-4173-ba8e-fbaf35eb5e14"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:37.769487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:37.769981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:37.770567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:37.782660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:37.789749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] Creating event network-vif-deleted:22c4f251-4487-4173-ba8e-fbaf35eb5e14 for instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 on hv-cinder-86156 Oct 23 00:10:37.797614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-04123120-f930-4630-bc77-6d5cab8a2f81 req-d46d12d4-adb2-4047-bead-b2c9ee2ce724 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056744 Oct 23 00:10:37.799397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 169/338] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:37.802367 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6276c8de-2c99-431e-9997-23769b3c7a20 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.483473 Oct 23 00:10:37.818513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 170/339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:37 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:38.065688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:38.066655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:38.078008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.078645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.079399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.080767 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.081989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.082740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.147349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:38.147957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:38.157698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.158429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.159221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.160075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.161238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.161815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.513989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:38.537054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-484e4dd1-7fb5-4163-bd65-9d9ab37ce1db tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1462 microversion: 2.1 time: 0.395012 Oct 23 00:10:38.537841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:38 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1462 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:38.649128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:38.690175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-54917f15-888b-455c-8590-436277da376a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.632817 Oct 23 00:10:38.690795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 170/341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:38 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:38.753861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:38.755245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:38.763354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.764352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.765978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.767299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.767913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.768600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.830829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:38.832609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:38.846461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.847619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.850187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:38.852725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:38.853792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:38.854497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:39.067594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:39.076639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f278ecfb-57af-4674-aa3f-c7b8d4943ebd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.327530 Oct 23 00:10:39.095794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 172/342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:38 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:39.175175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:39.190285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e0867897-55be-4913-819b-8fc9ecb29bbe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.365063 Oct 23 00:10:39.193016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 171/343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:38 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:39.572677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:39.580070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:39.588524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:39.588826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:39.589516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:39.590586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:39.591196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:39.591758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:39.701633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:39.717851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:39.718979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8f5a6d90-bfb4-4c8e-8fc0-362d2ae2d658 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1462 microversion: 2.1 time: 0.159848 Oct 23 00:10:39.719581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:39.719945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 173/344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:39 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1462 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:39.729431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:39.731900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:39.732811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:39.734260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:39.735496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:39.736297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:39.792047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-13b17da8-e982-4235-bf96-1dd7a780b5a7 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'create', calling method: .version_select at 0x7f3f8dcb40d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-384261082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOERDRRR9QMERbbuRnLFwH7vA1+diACtBhd9YfoKikVMWXEs4Pf+F3hlmH/POCqM+VcwKQUGSZkqTorlaa4FM7oUuOcvcsC/HUjXFfaaRf6+cdBESREbijtJiPRt5nNWMw=="}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:39.817808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-13b17da8-e982-4235-bf96-1dd7a780b5a7 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Getting quotas for project 10a83daa0cad4d0fb210247c411e4c0a. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:39.822824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-13b17da8-e982-4235-bf96-1dd7a780b5a7 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Getting quotas for user fb594a081d194e709023dc7c557afe4c and project 10a83daa0cad4d0fb210247c411e4c0a. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:39.891662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-13b17da8-e982-4235-bf96-1dd7a780b5a7 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104084 Oct 23 00:10:39.892833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 174/345] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:10:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:10:39.998916 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:40.007666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b8ddd0db-c9df-448b-9b5f-db1c6f7037c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.294323 Oct 23 00:10:40.020639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 172/346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:39 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:40.058800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-787309971", "imageRef": "2d4877f8-a08e-4021-aac5-252336f6b6a5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-384261082", "networks": [{"uuid": "fcdc91c6-3c78-4ecc-a9fa-ed781879216c"}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:40.103018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:40.103642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:40.111011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.111675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.112262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.112858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] validate_networks() for [('fcdc91c6-3c78-4ecc-a9fa-ed781879216c', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:10:40.113367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.113995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.114575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.314634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:40.322494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7c181919-83c9-4fe7-ba24-6f644cceadce tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.223637 Oct 23 00:10:40.323552 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 173/347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:40 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:40.328785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:40.329751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:40.335734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.336319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.337029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.337803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.338351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.338884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.548667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:40.556931 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ece53d7a-afb9-49bb-968a-aa7435704eef tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.232104 Oct 23 00:10:40.557807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 174/348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:40 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:40.643503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:10:40.644001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:10:40.644569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:10:40.645042 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:10:40.645753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:10:40.654818 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.655294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.656430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.657190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.657644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.658063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.676509 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Getting quotas for project 10a83daa0cad4d0fb210247c411e4c0a. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:40.680362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Getting quotas for user fb594a081d194e709023dc7c557afe4c and project 10a83daa0cad4d0fb210247c411e4c0a. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:40.691747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:10:40.694059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4877f8-a08e-4021-aac5-252336f6b6a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:10:40.745014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:40.745855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2f3590d1-6645-4b7d-9e11-e1eb1379f7b6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691024 Oct 23 00:10:40.746683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:40.746828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 175/349] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:10:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:10:40.754129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.754821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.755411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.756426 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:40.757046 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:40.757646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:40.759547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1d026291-d4a3-4b13-aa1b-ada4d101ac6c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:40.760297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1d026291-d4a3-4b13-aa1b-ada4d101ac6c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:40.853073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1d026291-d4a3-4b13-aa1b-ada4d101ac6c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:40.860707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1d026291-d4a3-4b13-aa1b-ada4d101ac6c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1257 microversion: 2.1 time: 0.105400 Oct 23 00:10:40.877438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 176/350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:40 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1257 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:40.899494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:40.908572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-74cb00d7-8e77-4cf9-9803-dcf57cce03f2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.167287 Oct 23 00:10:40.909349 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 175/351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:40 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:41.032400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:41.033808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:41.040230 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.040756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.041353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.042456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.042856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.043429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.283856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:41.291767 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7282c78f-70f4-4a59-be1b-6a7f6f5a5fc7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.264342 Oct 23 00:10:41.297020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 177/352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:41 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:41.346552 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:41.347162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:41.353228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.353703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.354134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.354807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.355257 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.355679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.490115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:41.497712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-da68c4b0-2551-4044-b178-1de7a0043458 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.155309 Oct 23 00:10:41.498269 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 176/353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:41 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:41.581329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:41.581862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:41.587857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.588341 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.588880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.589570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.590031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.590460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.725773 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:41.733832 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d6386250-f478-4a9b-b9b5-0a18a4dde533 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.156515 Oct 23 00:10:41.734605 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 178/354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:41 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:41.886504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:41.887119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:41.893983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.894478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.894915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.895602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.896059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.896587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.933704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:41.934518 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:41.941699 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.942187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.942616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.943319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:41.944421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:41.944886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:41.962002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:41.970230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5296233d-bd05-44d2-a126-295b3413c9da tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.087616 Oct 23 00:10:41.971206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:41 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:42.014337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:42.022614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f413847b-0bb5-4a6f-a9dc-701e5b5a94d3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.093302 Oct 23 00:10:42.023177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 179/356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:41 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:42.315701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:42.316249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:42.322627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.323115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.323556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.324243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.324729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.325158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.344606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:42.458958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:42.466635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a34a63bc-d270-4189-94a7-cce528be912c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.155557 Oct 23 00:10:42.467198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 178/357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:42 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:42.519675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:42.520278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:42.526161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.526626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.527054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.527722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.528197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.528645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.655053 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:42.662753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-903088b6-d3f4-4328-bcf2-7324e6d39a4f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.147605 Oct 23 00:10:42.663319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 180/358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:42 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:42.758164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:42.758846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:42.767055 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.767902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.768437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.769433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:42.770132 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:42.770636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:42.919059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:42.938314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-76652581-fc2f-4fcb-b97d-76a9e4d1f075 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.184378 Oct 23 00:10:42.938906 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 179/359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:42 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:42.993211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:42.993827 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:42.999819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.000297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.000774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.001463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.001916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.002363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.046717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:43.047375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:43.053357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.053841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.054271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.054955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.055408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.055825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.063161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:43.071348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-780d6c0d-2118-4b23-88f8-d190ae27bd0c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.081914 Oct 23 00:10:43.071922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 181/360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:42 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:43.117966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:43.125753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4259cfa4-4b8f-4507-92e6-56159d8c0430 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.083431 Oct 23 00:10:43.126316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:43 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:43.490404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:43.491007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:43.496993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.497501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.497972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.498671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.499163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.500157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.518494 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:43.635013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:43.647061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-76c9eb20-bff9-4079-9566-be560866d21b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.160391 Oct 23 00:10:43.647635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 182/362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:43 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:43.685974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:43.686587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:43.694802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.695308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.695737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.696425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.696908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.697327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.845243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:43.853398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fc50bf8c-d410-4553-8393-865da47b0e4a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.171217 Oct 23 00:10:43.853974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 181/363] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:43 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:43.965363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:43.966441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:43.977954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.978863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.979488 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:43.980845 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:43.981614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:43.982303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.094949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:44.095733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:44.102423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.102915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.103594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.104303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.104781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.105206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.134321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:44.142309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a78f521b-dc08-4972-8429-5a4be4183ea9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.183923 Oct 23 00:10:44.142886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 183/364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:43 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:44.148419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:44.149063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:44.155466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.155967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.156428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.157354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.157813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.158242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.172801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:44.180708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8ba7ec61-a445-4aad-b0f7-02db9b0034cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.089613 Oct 23 00:10:44.181365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 182/365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:44 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:44.224055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:44.231807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d45e20fc-ff6f-42bc-a36a-f924ef199cae tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.087023 Oct 23 00:10:44.234191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 184/366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:44 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:44.670665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:44.671908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:44.677867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.678355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.678787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.679472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.679923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.680353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.808915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:44.816584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ea33a034-f9b4-457a-b33c-c1aa949a6f72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.149783 Oct 23 00:10:44.817179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 183/367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:44 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:44.876268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:44.876908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:44.883549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.884032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.884475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:44.885223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:44.885679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:44.886108 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.024434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:45.032795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-267c8bb4-181a-4755-8de2-24c18c93289f tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.160257 Oct 23 00:10:45.033359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 185/368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:44 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:45.165834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:45.166444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:45.172613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.173101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.173554 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.174221 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.174678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.175096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.206630 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:45.207270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:45.213444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.213930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.214366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.215059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.215511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.215939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.295529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:45.303375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-68f6dfaa-5e56-4467-ac68-bc178b02b3f0 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.101113 Oct 23 00:10:45.303975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 186/369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:45 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:45.308417 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:45.309140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:45.315614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.316101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.316549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.317309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.317750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.318170 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.328222 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:45.336070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-51ddca53-75fd-4c5d-9e52-a494f3221f63 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.174085 Oct 23 00:10:45.336760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 184/370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:45 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:45.382024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:45.389628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3969d0b0-bc73-418a-8376-02d84ec878a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.084677 Oct 23 00:10:45.390836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 187/371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:45 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:45.840828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:45.841439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:45.847678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.848158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.848641 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.849329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:45.849785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:45.850209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:45.980672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:45.988838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e73950ad-44e0-48a3-9b8d-00029f91194b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.151906 Oct 23 00:10:45.989394 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 185/372] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:45 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:46.056137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:46.056951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:46.063069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.063547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.063980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.064701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.065156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.065572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.204479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:46.212161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c66c0c0b-7ed0-48ef-9227-5b6938156143 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.160573 Oct 23 00:10:46.212747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 188/373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:46 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:46.327186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:46.328350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:46.334669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.335167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.335595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.336270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.336745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.337162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.359106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:46.359722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:46.365837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.366321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.366809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.367496 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.368008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.368439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.403764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:46.413047 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4c6aaf31-db9c-44e3-bc96-a0f3169135cb tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.089683 Oct 23 00:10:46.415177 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 186/374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:46 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:46.420000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:46.420630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:46.427241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.427816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.428239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.428948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:46.429398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:46.429816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:46.500842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:46.508527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-03ac5200-1f43-4059-9df2-fddea6e824fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.092284 Oct 23 00:10:46.509087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 187/375] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:46 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:46.531980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:46.539949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2a0a806a-8be5-41e5-8992-b54fd527a10e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.184618 Oct 23 00:10:46.540471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 189/376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:46 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:47.012694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:47.013250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:47.019849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.020330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.020799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.021482 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.021936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.022359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.154231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:47.162087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dd96e5ff-3c0f-4bc5-8d55-73d6de0b7940 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.153247 Oct 23 00:10:47.162650 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 188/377] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:47 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:47.235993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:47.236712 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:47.243058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.243545 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.243984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.244761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.245186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.245730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.384189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:47.392278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-87a36e25-19da-48f7-976c-b9c8e5af7a96 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.161115 Oct 23 00:10:47.392977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 190/378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:47 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:47.436746 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:47.437895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:47.443769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.444250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.444721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.445402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.445853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.446275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.507192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:47.514723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f297f418-d6fb-4375-99f2-5f033be8ff73 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.081957 Oct 23 00:10:47.515539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 189/379] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:47 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:47.532014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:47.532586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:47.538415 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.538903 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.539323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.540000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.540449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.540989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.563720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:47.564323 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:47.570247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.570744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.571174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.571846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:47.572285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:47.572726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:47.606344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:47.615031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-bdd69071-f833-42d4-a8f0-9e87dff670f4 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.087785 Oct 23 00:10:47.615611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 191/380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:47 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:47.700589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:47.708263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-53d3bbf7-6916-4335-9460-c4d2aed9f7c5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.148865 Oct 23 00:10:47.708856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 190/381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:47 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:48.185212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:48.185809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:48.192228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.192733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.193166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.193844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.194290 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.194717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.323827 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:48.332095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3aa44510-b34a-4030-a0f1-092ba2ec72ac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.150676 Oct 23 00:10:48.332690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 192/382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:48 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:48.415304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:48.415901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:48.422192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.422958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.423388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.424062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.424802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.425221 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.537428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:48.538032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:48.544032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.544534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.544973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.545663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.546247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.546875 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.558096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:48.566516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-74d74427-27b5-470d-b353-4e3201f1b6fc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.155302 Oct 23 00:10:48.567292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 191/383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:48 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:48.606444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:48.614944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-aebd566d-1c0b-43bb-9999-8937547adcd4 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.081255 Oct 23 00:10:48.615453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 193/384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:48 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:48.637978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:48.638581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:48.644969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.645446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.645870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.646542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.647007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.647410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.708262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:48.715886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-08676d77-0f32-4f1a-b607-2bf32067153e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.081743 Oct 23 00:10:48.716444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 192/385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:48 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:48.732119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:48.732761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:48.739138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.739618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.740057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.740768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:48.741248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:48.741676 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:48.878453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:48.886374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b221d3c9-47fa-421a-a7bc-346a62fe0f66 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.158096 Oct 23 00:10:48.886936 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 194/386] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:48 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:49.355609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:49.356209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:49.362214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.362692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.363116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.363787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.364239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.364680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.498455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:49.506722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e22b7d48-bfb9-497e-9b78-18ded9c75ae9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.154955 Oct 23 00:10:49.507287 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 193/387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:49 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:49.589845 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:49.590461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:49.597956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.598443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.598879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.599570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.600022 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.600450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.637769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:49.639011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:49.646367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.647147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.647575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.648267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.648742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.649156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.731862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:49.741308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3ce8296f-6fe7-4ed3-92dc-d52d6a8767ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.107157 Oct 23 00:10:49.756787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 194/388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:49 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:49.767063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:49.767495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b12f6d-d6e5-426e-8f87-6ce5c17f67f0", "name": "network-vif-plugged", "status": "completed", "tag": "a78d73f6-5ef9-4c17-87ef-1ebb3a307639"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:49.776939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3f72b136-2dbc-4ea7-8b8b-19ff9a7ee394 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.190851 Oct 23 00:10:49.778074 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 195/389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:49 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:49.779535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.779942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.780367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.784999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:49.785673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:49.787378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:49.794220 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] Creating event network-vif-plugged:a78d73f6-5ef9-4c17-87ef-1ebb3a307639 for instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 on hv-cinder-86156 Oct 23 00:10:49.795113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.795612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.796112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.796954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.797388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.797825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.799719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-6c517a29-a577-4232-a66a-43f26a4135b7 req-a6176c1e-a89c-45a2-a7db-098b0b624b4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040520 Oct 23 00:10:49.800521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 195/390] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:49.865407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:49.873569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-730ceecd-910b-4759-8376-b3361789c361 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.094204 Oct 23 00:10:49.874137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 196/391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:49 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:49.910922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:49.911629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:49.917801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.918228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.918663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:49.919347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:49.919803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:49.920228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.047966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:50.055690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4882a73f-dfc7-4279-9bff-15697da543ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.149018 Oct 23 00:10:50.056244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 196/392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:49 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:50.531093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:50.531747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:50.537626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.538107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.538542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.539223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.539677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.540100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.666398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:50.674763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:50.682315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3076a064-d0e7-4a66-bf77-4410e1046ef5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.155576 Oct 23 00:10:50.682882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 197/393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:50 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:50.766088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:50.766596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:50.772869 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.773355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.773792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.774477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.774934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.775359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.800054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:50.800703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:50.806687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.807167 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.807603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.808345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.808821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.809250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.838535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:50.846905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ef8ca373-bd8c-4beb-a35f-780c9022de3d tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1261 microversion: 2.1 time: 0.084481 Oct 23 00:10:50.847475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 197/394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:50 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:50.860348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=12 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:50.897338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:50.897954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:50.904060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.904599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.905040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.905955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:50.906415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:50.906843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:50.947662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:50.956912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6309ef84-6b9a-457c-8e2e-caff77544736 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.160640 Oct 23 00:10:50.957729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 198/395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:50 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:50.977331 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:50.985700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8246e5cd-1c0e-4042-8cc2-6e7a70495859 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1299 microversion: 2.1 time: 0.092286 Oct 23 00:10:50.986279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:50 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:51.080762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:51.081404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:51.087609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.088123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.088587 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.089466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.089925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.090645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.094983 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:51.466828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:51.477321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0b3d9c64-3ff5-43c9-badb-d89114c1615a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.401053 Oct 23 00:10:51.478314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 199/397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:51 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:51.704996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:51.708339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:51.714519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.715078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.715515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.716227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.716709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.717134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.854546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:51.862771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-688981c8-194f-48a3-8c9c-d44687852947 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.162244 Oct 23 00:10:51.863336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 199/398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:51 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:51.870455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:51.871976 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:51.879484 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.880216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.880756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.881561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.882086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.882600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.962947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:51.975644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-bfc59896-f9a9-41b2-bb76-fa9c737762a5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1253 microversion: 2.1 time: 0.109059 Oct 23 00:10:51.979941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:51.980929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:51.985652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 200/399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:51 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1253 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:51.988690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.989429 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.990051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:51.991174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:51.991834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:51.992442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.009848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:52.010474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:52.018324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.019098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.019948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.021004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.021920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.022680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.056572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.057059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.057497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.057945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lazy-loading 'fault' on Instance uuid 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:10:52.158279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:52.166469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-147a0477-aeaf-43d0-b1ab-d5088d2de542 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1304 microversion: 2.1 time: 0.161813 Oct 23 00:10:52.167156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 201/400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:52 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:52.431029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:52.438913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-689b1a06-821d-4ca3-be96-3a0316be73f9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.462977 Oct 23 00:10:52.439664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 200/401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:51 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:52.501455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:52.502368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:52.504186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:52.509574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.510099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.510487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.511177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.511628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.512051 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.731716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:52.740718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-66bf49b0-d42a-4168-862c-f0fda2c86af7 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.243082 Oct 23 00:10:52.741286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 202/402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:52 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:52.796479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c513ed3-7e00-4e46-be58-572838fb4eae", "name": "network-vif-plugged", "status": "completed", "tag": "6a22a4da-def7-49ce-bbfb-af423b29e223"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:52.807206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.807766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.808099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.821365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] Creating event network-vif-plugged:6a22a4da-def7-49ce-bbfb-af423b29e223 for instance 5c513ed3-7e00-4e46-be58-572838fb4eae on hv-cinder-86156 Oct 23 00:10:52.826938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-9fc31c12-964c-4118-b70e-ae2786a91abf req-d81f6c8d-7b04-458c-85aa-0d499935a17f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 Oct 23 00:10:52.828158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 201/403] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:10:52.888366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:52.889010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:52.896357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.896877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.897351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:52.898270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:52.898731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:52.899159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.001146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:53.001846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:53.010952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.015110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.015557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.016540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.017169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.017594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.116514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:53.133951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:53.134166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-da1cfa2d-0332-41df-ae65-bd15fc485b35 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1253 microversion: 2.1 time: 0.136956 Oct 23 00:10:53.135250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 202/404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:52 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1253 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:53.155685 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9cb66c9f-c7e7-4af1-b935-0fe284cbc960 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.271855 Oct 23 00:10:53.157606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 203/405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:52 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:53.193123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:53.193921 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:53.200922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.201416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.202140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.203039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.203483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.203908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.240039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.240543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.240977 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.241417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lazy-loading 'fault' on Instance uuid 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:10:53.287531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:53.296646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-761ef703-df4a-4871-9fae-c688aac2bc30 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 200 len: 1304 microversion: 2.1 time: 0.107236 Oct 23 00:10:53.298127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 203/406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:53 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:53.463158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:53.463795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:53.470236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.470725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.471156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.472291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.472783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.473208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.765657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:53.775583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dc521db7-e7b5-4562-a515-09e4b0418faa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.316391 Oct 23 00:10:53.776072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:53.777011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:53.778940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 204/407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:53 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:53.791583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.792308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.793736 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.795204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:53.795784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:53.797725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:53.995487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:54.004854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-585a4621-3f61-4e9e-bb1a-e52426474344 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1501 microversion: 2.1 time: 0.240963 Oct 23 00:10:54.012834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 204/408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:53 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:54.028298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c7184ef-1fd7-4886-8589-abe36a267f3c"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:54.031580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.038330 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.038799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.039242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.039942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.040399 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.040857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.065337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] HTTP exception thrown: Cannot 'attach_volume' instance c788f89c-5620-4a79-aca6-4b2dce29abc0 while it is in vm_state rescued Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Request method failure captured: Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/os-volume_attachments HTTP/1.1 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 74 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXk1DB64OEAO_HayivPa4yPZnDukTjOII3htOFeeqadFEOqR64Ehe_Mm50U0KJvGZFXoIsJj6XeHGetH-BodUiK9ume33fiu7M0ZqUoY2oYVxsyWYjEszyySS1TBVt03CpOhyZpGTaY5bfsPeKf5sZaZV8zqYW2nE1WkUpGicre-0U Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:10:54.067073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08beca89c7f747229a3cc6cb6a363af4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f95f4fc0d5c5428c96545f543139489b Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {"volumeAttachment": {"volumeId": "4c7184ef-1fd7-4886-8589-abe36a267f3c"}} Oct 23 00:10:54.068743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Cannot 'attach_volume' instance c788f89c-5620-4a79-aca6-4b2dce29abc0 while it is in vm_state rescued Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'server_id': 'c788f89c-5620-4a79-aca6-4b2dce29abc0', 'body': {'volumeAttachment': {'volumeId': '4c7184ef-1fd7-4886-8589-abe36a267f3c'}}} Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:10:54.069633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c788f89c-5620-4a79-aca6-4b2dce29abc0 while it is in vm_state rescued Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:10:54.071141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c788f89c-5620-4a79-aca6-4b2dce29abc0 while it is in vm_state rescued Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Returning 409 to user: Cannot 'attach_volume' instance c788f89c-5620-4a79-aca6-4b2dce29abc0 while it is in vm_state rescued {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:10:54.072658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-93ad0976-9701-414c-8bfe-a1b7f4557f3c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044269 Oct 23 00:10:54.073104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 205/409] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:10:54 2022] POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 00:10:54.078998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:54.079539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.085613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.086122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.086553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.087254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.087686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.088095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.159732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:54.163262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.163602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-47c09861-2840-4ea1-907b-4eb9d26679e1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/action" status: 202 len: 0 microversion: 2.1 time: 0.088879 Oct 23 00:10:54.164206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 205/410] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:10:54 2022] POST /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:10:54.172664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.173182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.173504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:54.173615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.174123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.174342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.174799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.175222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.180382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.181257 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.181566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.182773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.182773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.183334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.274346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:54.283848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6a1540a9-f5d5-4590-bb56-5b7bd432741f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1309 microversion: 2.1 time: 0.130348 Oct 23 00:10:54.285124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 206/411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:54 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:54.290906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:54.291615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.301255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.301954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.302643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.304157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.304994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.305705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.603378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:54.612745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-26a415cb-cfd9-4e70-acac-0823c0e230a3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1509 microversion: 2.1 time: 0.443488 Oct 23 00:10:54.614117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 206/412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:54 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:54.619621 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:54.620447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.627165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.627849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.628464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.629336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.629950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.630374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.649722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] HTTP exception thrown: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Request method failure captured: Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 HTTP/1.1 Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZV2FRJQvddak5zL2xPsm0QWh1CybUYf7GBu8jpq1twnjETE-6KLqTzHw_Dv4waCkIVVRYHR_-4HNmScz4jyy9oKWBOXLn7J6Cwieu_QndUuTd0gDqv4CjNs22QLO9YWl2VrdBcP4GA4OgIOCkCmPFvZlYUVq3-ZdLa03dsyT5yiSk Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: bcef7335dafe4b29960c12ce5ab5330b Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesActionsTest-1403877354 Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:10:54.652445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bcef7335dafe4b29960c12ce5ab5330b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesActionsTest-1403877354 Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: bcef7335dafe4b29960c12ce5ab5330b Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesActionsTest-1403877354 Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesActionsTest-1403877354-project Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 63286ecd4376471f8ab5f647674eaf43 Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesActionsTest-1403877354-project Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. Oct 23 00:10:54.654106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '9d022d3f-9f5d-4d1d-b7e5-64c8df6da013'} Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:10:54.655006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. Oct 23 00:10:54.657204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:10:54.659529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Returning 404 to user: Instance 9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:10:54.661066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-94e59c3a-d4de-48b9-8071-3b3609be30b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013" status: 404 len: 111 microversion: 2.1 time: 0.045164 Oct 23 00:10:54.662905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:54 2022] GET /compute/v2.1/servers/9d022d3f-9f5d-4d1d-b7e5-64c8df6da013 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:10:54.694930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:54.714602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d5f1db87-7ec4-4de7-9937-a687f650979b tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1363 microversion: 2.1 time: 0.426678 Oct 23 00:10:54.715255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 207/414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:54 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1363 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:54.808673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:54.809501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:54.811904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:54.821232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.824619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.825420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.827966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:54.830212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:54.830825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:54.903533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1490417275", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "networks": [{"uuid": "61d93521-8718-4076-be2f-51df1dfb85c0"}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:10:54.993960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] validate_networks() for [('61d93521-8718-4076-be2f-51df1dfb85c0', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:10:55.174133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:55.188478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b33047c1-7bbc-415c-bcaf-9ac9572f0ba4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.385454 Oct 23 00:10:55.192036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 208/415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:54 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:55.318441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:55.319492 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:55.330065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.330617 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.332256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.333272 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.333885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.334464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.454541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:55.464719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2b408469-90ad-4161-b68e-e5a9de6e4b34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1309 microversion: 2.1 time: 0.156467 Oct 23 00:10:55.465300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 209/416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:55 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:55.575037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:10:55.575979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:10:55.576464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:10:55.577612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:10:55.578068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:10:55.589923 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.590679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.591314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.592760 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.593273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.593711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.623658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Getting quotas for project bcef7335dafe4b29960c12ce5ab5330b. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:10:55.629354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Getting quotas for user 63286ecd4376471f8ab5f647674eaf43 and project bcef7335dafe4b29960c12ce5ab5330b. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:10:55.637198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:55.637857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:55.650810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.651359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.651743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.652450 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.654869 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.655530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.657060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:10:55.659440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:10:55.754490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-936ed3f3-b78f-46ba-bfb2-c047842707cf tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856728 Oct 23 00:10:55.755857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 208/417] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:10:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:10:55.762645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:55.763852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:55.775130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.776068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.777389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.778591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:55.780015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:55.781710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:55.937291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:55.949896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e62d8d25-4b06-46d6-be5b-647ed934edb0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1509 microversion: 2.1 time: 0.316329 Oct 23 00:10:55.955373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 210/418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:55 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:55.969648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9c6fb106-d57c-447a-a334-3d451720197e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:55.970894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9c6fb106-d57c-447a-a334-3d451720197e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:56.011192 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:56.021355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7ea2c890-bf2c-4d5e-a94e-fea43946c91f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1549 microversion: 2.1 time: 0.261942 Oct 23 00:10:56.021951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 209/419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:55 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1549 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:56.047586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:56.048356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:56.054130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9c6fb106-d57c-447a-a334-3d451720197e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:56.057096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.057928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.058540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.059257 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.059693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.060119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.064897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9c6fb106-d57c-447a-a334-3d451720197e tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1214 microversion: 2.1 time: 0.108361 Oct 23 00:10:56.065489 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 211/420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:55 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:56.191729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-431092df-9ea0-4d5f-b8bb-47f9ff0731c6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148884 Oct 23 00:10:56.199537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 210/421] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:10:56 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:10:56.218572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:56.219110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:56.227197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.240842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.241331 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.242113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.242867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.243326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.482259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:56.494711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:56.495325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:56.508667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-071f5e26-ad9f-4746-ae12-3066a09c3aea tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1319 microversion: 2.1 time: 0.294519 Oct 23 00:10:56.509466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 212/422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:56 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:56.510199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.510851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.511292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.511994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:56.512473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:56.512919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:56.585144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:56.596176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-268ccef9-d6f5-417d-9a5c-3fe5f47717e8 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1315 microversion: 2.1 time: 0.107455 Oct 23 00:10:56.600591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 211/423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:56 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:56.988230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:56.989180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:57.000044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.001185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.001930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.004798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.005459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.006059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.064620 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:57.095584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:57.096211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:57.114151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.114754 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.128835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.139490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.142155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.142941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.408267 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:57.416573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-07264860-99cf-4a32-9a4f-f2cef7841e99 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1210 microversion: 2.1 time: 0.327683 Oct 23 00:10:57.421746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 212/424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:57 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1210 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:57.531607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:57.532331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:57.542063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.542941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.545338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.546350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.554756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.555591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.634375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:57.651997 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-291b02e0-642d-48b7-ad4b-a51161701d38 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1509 microversion: 2.1 time: 0.680480 Oct 23 00:10:57.654486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 213/425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:56 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1509 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:57.674690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:57.675368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:57.682755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.683591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.684267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.685230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:57.685963 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:57.686599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:57.925599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:57.939588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-07c9258c-77f4-40b2-9fba-f93aeafc4228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1315 microversion: 2.1 time: 0.283815 Oct 23 00:10:57.952513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 214/426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:57 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:58.041318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:58.049933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5e3329a1-a518-468b-b44c-036990813e66 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1509 microversion: 2.1 time: 0.522078 Oct 23 00:10:58.051140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 213/427] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:57 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:10:58.447122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:58.447782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:58.458921 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.461914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.462513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:58.463443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.464811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.466742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:58.591378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:58.603525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-02cf2ded-d3f6-425f-996b-ee5d5a856f47 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1266 microversion: 2.1 time: 0.160779 Oct 23 00:10:58.604161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 215/428] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:58 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:58.681180 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:58.681908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:58.692260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.699980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.700612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:58.703043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.706224 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.707397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:58.929606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:58.942265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e6dc51c6-4dd9-4a5c-93bb-c5ccc5cec39a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1509 microversion: 2.1 time: 0.265414 Oct 23 00:10:58.956665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 214/429] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:58 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:58.963435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:58.964118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:58.971258 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.971998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.972633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:58.973562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:58.974013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:58.974597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:59.154102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:59.164018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0eb23b92-8657-4c0c-9665-5d65ceaf5233 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.204412 Oct 23 00:10:59.165522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 216/430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:58 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:59.632030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:59.632806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:59.640129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:59.642038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:59.642470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:59.643188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:59.643650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:59.644077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:10:59.731037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:10:59.743526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4cfdaada-1748-4248-b9c6-a4e489bffcfd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1266 microversion: 2.1 time: 0.119017 Oct 23 00:10:59.744129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 215/431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:59 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:10:59.972890 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:10:59.973604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:10:59.993666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:10:59.994269 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:10:59.998276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.005813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.006381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.006850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.160780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b12f6d-d6e5-426e-8f87-6ce5c17f67f0", "tag": "a78d73f6-5ef9-4c17-87ef-1ebb3a307639"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:00.221268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.221268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.221917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.311499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] Creating event network-changed:a78d73f6-5ef9-4c17-87ef-1ebb3a307639 for instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 on hv-cinder-86156 Oct 23 00:11:00.353910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-cd252a10-de61-4fd8-9b48-eb6cb27b5e2b req-ab48dd34-2579-49b7-bc7e-1ad2b58fc006 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207805 Oct 23 00:11:00.354567 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 216/432] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:00.369521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:00.370199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:00.382595 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.383473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.384080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.385076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.385693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.386329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.418945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:00.518195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:00.531346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a937ad79-6487-4f03-9821-e0a980c8c6ec tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1509 microversion: 2.1 time: 0.563473 Oct 23 00:11:00.534402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 217/433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:10:59 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:00.776555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:00.777385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:00.799683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.801896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.804056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:00.804942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:00.807077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:00.808305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:01.135378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:01.148242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:01.161711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d8361fb2-aa47-48d5-bfb0-c0896356446e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.797306 Oct 23 00:11:01.162094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1664e2d4-7692-40c5-b949-d99f87285c86 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1274 microversion: 2.1 time: 0.397246 Oct 23 00:11:01.162724 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 218/434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:00 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1274 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:01.185232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 217/435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:00 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:01.563269 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:01.564345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:01.582197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:01.583389 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:01.586977 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:01.590507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:01.592066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:01.595194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:02.190582 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:02.191954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:02.221813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:02.222321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:02.222763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:02.223483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:02.223938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:02.224388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:02.452963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:02.465219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9586a0fd-f9ec-4689-be2a-14e133edbc34 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.282019 Oct 23 00:11:02.466768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 218/436] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:02 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:02.484962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:02.486392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:02.513736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:02.514431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:02.515902 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:02.516841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:02.517627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:02.518429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:02.620585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:02.643951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a68930a8-cc95-4b05-b1ce-244e21bd7cf9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1515 microversion: 2.1 time: 1.086583 Oct 23 00:11:02.648602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 219/437] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:01 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1515 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:03.057709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:03.085558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-33403a78-b058-4ca6-96fd-6d15a5513228 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.613132 Oct 23 00:11:03.085558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 219/438] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:02 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:03.290122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:03.347190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:03.353221 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:03.353582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:03.391116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] Creating event network-changed:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:11:03.409570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-054a7dc1-7e75-4fbe-b8b3-b6f2b6ec6574 req-e7221310-20e2-43e7-ab88-d1c0766fd6eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125869 Oct 23 00:11:03.413700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 220/439] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:03.492698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:03.493314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:03.523892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:03.524398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:03.524837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:03.525551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:03.526384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:03.526384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:03.663102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:03.676161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b98c7f63-8497-43ea-ac51-0896b8b25b49 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.186481 Oct 23 00:11:03.677760 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 220/440] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:03 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:04.119777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:04.120579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:04.135766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:04.136839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:04.137543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:04.138509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:04.138971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:04.139398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:04.337373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:04.348256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c4dd609b-d323-4ed6-86b2-0c0e8ffe1172 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.240600 Oct 23 00:11:04.351833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 221/441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:04 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:04.411889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f1664b18-fee3-4d14-a8dc-fb07fb8f0c09 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: .version_select at 0x7f3f8d94bee0>, body: {"keypair": {"name": "tempest-keypair-229052915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqpzvAQbFAxKiW0PMmDNy/3ZYjBQQnto7kPotH9hP/hIeV6YoW3Ps/Bpr0ltNWzyW9TUOXF4xxzb5yiLRV/PvWFrEBt3oDOatafRTRmzPESgIfA6sptJ1O1WxDJk9Vnmg=="}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:04.439724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-f1664b18-fee3-4d14-a8dc-fb07fb8f0c09 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:11:04.449608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-f1664b18-fee3-4d14-a8dc-fb07fb8f0c09 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for user f95f4fc0d5c5428c96545f543139489b and project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:11:04.491900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f1664b18-fee3-4d14-a8dc-fb07fb8f0c09 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084386 Oct 23 00:11:04.500696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 221/442] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:11:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:04.703936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:04.704546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:04.717011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:04.719882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:04.722150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:04.723836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:04.725636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:04.726288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:04.930701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:04.949670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-53a4d14e-76e2-4c5f-9430-6ceb009536a2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.250638 Oct 23 00:11:04.954486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 222/443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:04 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:05.376908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:05.381600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:05.401814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:05.403754 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:05.404998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:05.408293 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:05.410962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:05.412735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:05.603793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:05.980698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:05.981384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:06.003101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:06.003718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:06.005099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:06.006007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:06.006608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:06.007143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:06.068377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:06.099404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:06.108644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0f3297ce-54d8-4f2e-b22a-a0e4b1ac9636 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.737814 Oct 23 00:11:06.114730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 222/444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:05 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:06.234432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:06.246454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7713904d-eabe-4dcb-b585-2031d1997d56 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.269840 Oct 23 00:11:06.247255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 223/445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:05 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:07.138464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:07.139459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:07.151993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:07.159512 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:07.160076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:07.161001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:07.161659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:07.162327 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:07.272924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:07.274002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:07.294059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:07.294059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:07.294059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:07.294059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:07.294593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:07.294929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:07.725158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:07.744990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fd076f38-9ddc-45ec-868d-ecc507789b8f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.470738 Oct 23 00:11:07.748367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 224/446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:07 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:08.058717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1897226437", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3cf21a0-16e9-4515-9796-e9995b9dcdd3"}], "security_groups": [{"name": "tempest-securitygroup--824722104"}], "key_name": "tempest-keypair-229052915", "user_data": "}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:08.089517 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:08.097799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0f5970de-9b31-46aa-8e05-ca17b6fb1720 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.963332 Oct 23 00:11:08.118725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 223/447] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:07 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:08.770734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:08.771624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:08.778866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:08.779656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:08.780384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:08.781281 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:08.781859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:08.782630 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:08.922847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:08.937618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1bee4af8-f10a-4822-a10f-f7829958d93f tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.171708 Oct 23 00:11:08.939112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 224/448] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:08 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:09.127428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:09.128408 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:09.134971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:09.135631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:09.136088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:09.136908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:09.137436 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:09.138011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:09.401869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:09.413585 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8ef8accb-1230-4b59-894c-9ef55d6565c3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.289941 Oct 23 00:11:09.414603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 225/449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:09 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:09.963084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:09.963764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:09.970959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:09.971667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:09.972695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:09.973663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:09.974329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:09.974969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:10.145649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:10.172422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6e448df3-8d9b-4535-a8d2-bad92b1e63b9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.214441 Oct 23 00:11:10.177324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 226/450] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:09 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:10.438015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:10.438762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:10.449899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:10.450902 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:10.451728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:10.453339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:10.454391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:10.455140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:10.672350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:10.682436 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-072837cd-4fbb-4bb0-8952-9341253a9767 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.249143 Oct 23 00:11:10.683023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 227/451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:10 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:10.760223 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] validate_networks() for [('e3cf21a0-16e9-4515-9796-e9995b9dcdd3', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:11:11.201547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:11.202149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:11.231675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.232210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.232981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.235838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.236450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.238732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.387996 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:11.406972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f986e558-69d5-4e74-9ac5-40300c37fde3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.209104 Oct 23 00:11:11.434885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 228/452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:11 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:11.664582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:11:11.664993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:11:11.665519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:11:11.665948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:11:11.666540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:11:11.695020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.695782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.696218 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.696985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.697435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.697846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.717549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:11:11.722353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Getting quotas for user f95f4fc0d5c5428c96545f543139489b and project 08beca89c7f747229a3cc6cb6a363af4. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:11:11.734198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:11:11.737327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:11:11.789303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3cf739b7-67b4-427d-b665-fac8d64fd804 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.736832 Oct 23 00:11:11.795974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 225/453] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:11:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 3739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 00:11:11.796245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c9660125-cdb4-473d-b48e-2955baf310dd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Action: 'create', calling method: .version_select at 0x7f3f8d88c8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1818066054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlhahfjY7APndFxi88Nz8P4VejD5qzxX1o2jGni2IBny9EMQDqJDjZYv58WIEF46lg2xdg5mK4Q+dasrpKQjuPHIfbE3p+fV1uWfuKP6AAuNp0hhrcSnosnjsZjPF369Q=="}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:11.796693 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:11.796693 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:11.802677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.803263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.803770 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.804575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:11.805166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:11.805675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:11.813210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-c9660125-cdb4-473d-b48e-2955baf310dd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Getting quotas for project 0401b24ace154000a2b9e80e785f1ce9. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:11:11.817578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-c9660125-cdb4-473d-b48e-2955baf310dd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Getting quotas for user cd59419dfebe46a28caad71b1454c53a and project 0401b24ace154000a2b9e80e785f1ce9. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:11:11.860307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c9660125-cdb4-473d-b48e-2955baf310dd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321927 Oct 23 00:11:11.862310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 229/454] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:11:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:11.868460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-aa3d7063-bdec-46c1-986c-09ee9c9504f1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:11.869341 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aa3d7063-bdec-46c1-986c-09ee9c9504f1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:12.015868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:12.026758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-aa3d7063-bdec-46c1-986c-09ee9c9504f1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:12.035010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0c793dce-259e-410b-b1c5-5ab2edfc8e3a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.243597 Oct 23 00:11:12.037854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-aa3d7063-bdec-46c1-986c-09ee9c9504f1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1245 microversion: 2.1 time: 0.173676 Oct 23 00:11:12.038819 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 226/455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:11 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:12.040102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 230/456] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:11 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:12.456105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:12.456755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:12.464075 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:12.466542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:12.467192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:12.468028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:12.468572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:12.469170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:12.546172 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:12.554785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-32fb54eb-f711-4b24-b5e8-ac2d1ef8720c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.107401 Oct 23 00:11:12.569534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 227/457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:12 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:13.060315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:13.061443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:13.064013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:13.064657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:13.071458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.072229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.072721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.073464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.073924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.074356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.075219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.075714 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.076145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.076871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.078182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.079237 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.176463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:13.185391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6be1298c-74b2-4bd8-a7f0-3ff5c591d6e2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1249 microversion: 2.1 time: 0.128901 Oct 23 00:11:13.186326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 231/458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:13 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1249 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:13.257923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:13.267335 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c3c88bbd-b331-4f38-8ac5-5768e32db6f3 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.207819 Oct 23 00:11:13.268357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 228/459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:13 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:13.579898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:13.580799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:13.594839 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.595338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.595775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.596476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:13.597273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:13.597703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:13.692342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:13.701323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-94c4ad1f-c89a-4e7d-b3de-35b76cdda072 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.125859 Oct 23 00:11:13.702175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 232/460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:13 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:14.209811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:14.210353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:14.217200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.217689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.218867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.220173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.220674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.221107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.285094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:14.291011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:14.291643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:14.293676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9ce75e41-eaa7-4eed-ad2a-8d1ae6d4a49f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1249 microversion: 2.1 time: 0.087782 Oct 23 00:11:14.294431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 229/461] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:14 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:14.300385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.301088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.301608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.302395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.302923 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.303619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.450697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:14.458681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8041f098-f35b-4a4e-b43d-9d07a5c42eb1 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.171829 Oct 23 00:11:14.459249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 233/462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:14 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:14.725573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:14.726184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:14.732090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.732601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.733035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.733806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:14.734330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:14.734752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:14.799735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:14.807334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-01ba89c5-088b-40c4-a0a5-cec08ef7dd3d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.085831 Oct 23 00:11:14.807820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 230/463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:14 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:15.319375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:15.319990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:15.322486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:15.328665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.329158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.329594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.330291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.330742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.331163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.406520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:15.415964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f452b89f-5898-4454-b38b-402c062077dc tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1249 microversion: 2.1 time: 0.100400 Oct 23 00:11:15.416575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 234/464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:15 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:15.485777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:15.486404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:15.495614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.496402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.497058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.498676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.500078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.501118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.528423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:15.666250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:15.674761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-45eaf77c-a6a4-4b77-84cf-abd12b900112 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.195575 Oct 23 00:11:15.675336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 231/465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:15 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:15.831173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:15.831792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:15.838254 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.838760 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.839180 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.839927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:15.840388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:15.840838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:15.907364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:15.912939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-720d989b-fa16-413a-83e9-1b0644b3adba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.085754 Oct 23 00:11:15.913521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 235/466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:15 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:16.439585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:16.440249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:16.446312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.446796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.447239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:16.447933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.448389 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.448845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:16.509823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:16.518180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2c61fd70-e4b2-4e50-912b-ee9ad3b2fa35 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1249 microversion: 2.1 time: 0.082821 Oct 23 00:11:16.518761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 232/467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:16 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:16.698126 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:16.698639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:16.705692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.706179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.706612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:16.707297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.707753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.708173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:16.849764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:16.857353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-72919de5-65b8-4303-b6f8-9f67ad477398 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.163179 Oct 23 00:11:16.857918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 236/468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:16 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:16.936368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:16.937562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:16.943412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.943889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.944320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:16.945065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:16.945516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:16.945935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:17.007898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:17.016284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-eda67a49-fb4b-40a1-9ce4-eaa44648dc28 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.083623 Oct 23 00:11:17.016868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 233/469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:16 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:17.541437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:17.542003 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:17.548850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:17.549319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:17.549761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:17.550439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:17.550898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:17.551324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:17.555652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:17.614735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:17.622325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7a2db423-4a5f-4cbd-bcb6-f3d54237ba91 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1249 microversion: 2.1 time: 0.084785 Oct 23 00:11:17.622895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 237/470] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:17 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:17.881212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:17.881818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:17.887639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:17.888112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:17.888567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:17.889244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:17.889717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:17.891125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:18.026431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:18.035293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5e10719f-e2ed-4b87-9972-3b5076843b24 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.157887 Oct 23 00:11:18.035984 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 234/471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:17 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:18.038871 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:18.040063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:18.047120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:18.047610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:18.048048 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:18.048777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:18.049232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:18.049657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:18.113358 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:18.120708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ba8f9eb0-b366-457e-94c5-66d98877e24b tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1272 microversion: 2.1 time: 0.085732 Oct 23 00:11:18.121280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 238/472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:18 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:18.647568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:18.648596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:18.655402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:18.656245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:18.656968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:18.657739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:18.658189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:18.658801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:18.855571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:18.865367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-57e5b34b-3d12-4208-af74-a14824121d78 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1297 microversion: 2.1 time: 0.222852 Oct 23 00:11:18.866165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 235/473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:18 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:19.059387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:19.060906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:19.073151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.073646 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.074303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.075522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.076173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.076825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.146942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:19.148196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:19.162560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.163954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.164854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.165761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.166329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.166709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.667473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:19.676922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-82a348b1-30ba-47c5-b580-71aa271eb072 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.621387 Oct 23 00:11:19.690754 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 239/474] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:19 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:19.694519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:19.695613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e831dd3a-0eea-4767-9245-368552561dc1", "tag": "e10f00a2-91a8-4562-8948-fb8d00c26768"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:19.703041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5955bcdd-6003-45d9-8cbf-d5c582e9722d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.559908 Oct 23 00:11:19.703620 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 236/475] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:19 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:19.705135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.705607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.706059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.717310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] Creating event network-changed:e10f00a2-91a8-4562-8948-fb8d00c26768 for instance e831dd3a-0eea-4767-9245-368552561dc1 on hv-cinder-86156 Oct 23 00:11:19.723228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-8f07b84e-62c0-4fa6-b3c8-7236f0540dbf req-c257bd8e-ed8d-4c53-9ec1-2d5055000d23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031211 Oct 23 00:11:19.723847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 240/476] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:19.889105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:19.889713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:19.896058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.896573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.897008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.897694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:19.898143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:19.898584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:19.961138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:19.969989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4a4509ca-feff-457b-ba1b-239761d93e65 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1297 microversion: 2.1 time: 0.084705 Oct 23 00:11:19.970401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 237/477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:19 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:20.703191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:20.704728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:20.711937 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:20.712526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:20.713032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:20.713810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:20.714336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:20.714831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:20.740623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:20.741507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:20.749860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:20.750628 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:20.751072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:20.751774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:20.752235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:20.752709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:21.027742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:21.036687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-00746626-1f09-4910-835d-151622ad1f1a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.339073 Oct 23 00:11:21.037365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 241/478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:20 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:21.049732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:21.052032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:21.052821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:21.058806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-676ad879-58c6-42dd-8eed-b175d458f2e6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.333955 Oct 23 00:11:21.059368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 238/479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:20 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:21.059914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:21.060715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:21.061172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:21.062017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:21.062649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:21.063085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:21.136199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:21.144511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-be833e02-8d43-44ac-b2f6-1c869c5484fe tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1303 microversion: 2.1 time: 0.100297 Oct 23 00:11:21.145223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 242/480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:21 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:22.063072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:22.063822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:22.066871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:22.067889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:22.072638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.073130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.073599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.074296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.074749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.075167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.082342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:22.083226 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:22.086655 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=16 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:22.090217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.090697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.091191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.092003 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.092616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.093781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.300795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:22.304020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:22.308542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0b7da037-33a1-4499-9448-455b224023fc tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.230686 Oct 23 00:11:22.309231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 243/481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:22 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:22.312103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-088b1ba0-06dd-41b9-962a-66af9d231eba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.252880 Oct 23 00:11:22.312900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 239/482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:22 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:22.314176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:22.314953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:22.327023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.328354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.329146 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.329951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:22.330534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:22.330855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:22.464575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:22.473079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4be1b7ff-82c2-449b-96c6-1d2fdba46307 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.162906 Oct 23 00:11:22.473639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 244/483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:22 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:23.331926 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:23.332568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:23.338909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.339104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:23.339558 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.339684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:23.339822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.340553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.341011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.341434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.346400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.346876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.347565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.348279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.348759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.349177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.546473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:23.551817 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:23.554836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-91e9875d-b08a-43c0-a2ab-8703f0cf4edb tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.227012 Oct 23 00:11:23.555505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 240/484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:23 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:23.559721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-088329fb-4279-4917-aaa4-0bb57a7e46e2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.224462 Oct 23 00:11:23.560038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:23.560636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 245/485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:23 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:23.560902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:23.567428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.568021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.568803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.569385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:23.569941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:23.570466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:23.706694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:23.714359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3f1eca53-b4ee-4b6d-9467-4e97063b7aa1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.157849 Oct 23 00:11:23.714918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 241/486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:23 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:24.579458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:24.580090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:24.583655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:24.584268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:24.586589 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.587066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.587500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.588319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.588892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.589343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.590355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.590839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.591275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.591956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.592412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.592864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.783338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:24.789530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:24.791323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a7252269-82ab-4782-83b1-eb67276e2a25 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.216768 Oct 23 00:11:24.792070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 246/487] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:24 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:24.797880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:24.798479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:24.805643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-541ab14f-248b-4627-a3d1-8ccae25f4fd5 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.225642 Oct 23 00:11:24.807797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.808356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.808898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.809758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:24.810215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:24.810642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:24.815717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 242/488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:24 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:24.943788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:24.951690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-86763360-625f-4644-801c-625a5fa81cdd tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.158010 Oct 23 00:11:24.952759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 247/489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:24 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:25.082985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c60a58cc-a812-4adf-a436-b8a7a9790881", "device": "/dev/sdb"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:25.085945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:25.087739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:25.092910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.093880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.094392 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:25.095071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.095519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.095939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:25.470247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0320f7dd-b1ce-44a2-8656-9ef8bf4882b5 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "POST /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391061 Oct 23 00:11:25.477138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 243/490] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:11:25 2022] POST /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:25.815748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:25.816474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:25.822950 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.823433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.823952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:25.824687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.825144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.825578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:25.831134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:25.831882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:25.841930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.842798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.843436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:25.844348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:25.845248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:25.846013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:26.123944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:26.127522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:26.134334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-603e614a-5b3e-49d8-9da5-7c209183e132 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.309093 Oct 23 00:11:26.145057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 244/491] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:25 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:26.145222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-78ae6767-6075-4090-a55c-c9b40bd77c22 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.324949 Oct 23 00:11:26.145222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 248/492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:25 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:26.145395 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:26.149928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:26.150567 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:26.156945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:26.157628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:26.158224 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:26.159122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:26.159737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:26.160334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:26.161157 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:26.161631 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:26.163136 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:26.176112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] Creating event network-changed:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:11:26.181133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-4f8ccb52-7d06-47f3-aa75-7764648a50b7 req-a20590e9-5f2c-48e1-8814-0683a4a38886 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044963 Oct 23 00:11:26.181939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 245/493] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:26.310591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:26.319291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8cda90d9-9200-4459-bb67-df0ecb24b09a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.181068 Oct 23 00:11:26.319947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 249/494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:26 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:27.158632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:27.159324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:27.166130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.166610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.167041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.167718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.168162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.168535 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:27.168947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.169153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:27.175905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.176388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.176853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.177549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.178001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.178427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.370279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:27.373089 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:27.379872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-57f31d5a-c7cc-416a-89a1-ef69a637eb9c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.226408 Oct 23 00:11:27.381064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 246/495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:27 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:27.381352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7d3ac20e-54d4-4da7-a50d-b73548588fe0 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.216675 Oct 23 00:11:27.382081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 250/496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:27 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:27.385694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:27.386300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:27.396151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.396151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.396151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.396151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:27.396610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:27.396610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:27.413178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:27.528750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:27.537564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9a9df96e-114f-4161-9d8a-086e9931fcc0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.155358 Oct 23 00:11:27.538129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 247/497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:27 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:28.403086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:28.403632 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:28.410363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.410838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.411301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.411401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:28.411940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:28.412039 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.412422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.414041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.418716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.419201 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.419696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.420328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.420764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.421717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.602978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:28.612233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8f4c1bde-d981-4bcf-9532-f20ad6b83c83 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.213017 Oct 23 00:11:28.612847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 251/498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:28 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:28.614544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:28.617286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:28.617888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:28.623730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.623899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b0fa05e8-fa58-45e8-8682-454ebba6beba tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.216115 Oct 23 00:11:28.624377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.624978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.625225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 248/499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:28 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:28.625678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:28.626134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:28.626559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:28.759276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:28.767301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f6319e08-2458-4a4b-a234-7d0f618e2d1e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.153503 Oct 23 00:11:28.767881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 252/500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:28 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:29.064227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "name": "network-vif-plugged", "status": "completed", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:29.073859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.074346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.074757 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.086637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] Creating event network-vif-plugged:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:11:29.091331 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-65a1610b-f8b4-4cdd-83f9-89e15da259e9 req-49405ac3-882e-46ff-acd6-9af3b66fef4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031228 Oct 23 00:11:29.091914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 249/501] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:29.635058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:29.635667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:29.642756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.643240 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.643677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.644363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.644838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.645261 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.647913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:29.648638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:29.654781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.655261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.655730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.656420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.656901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.657329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.839680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:29.848542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5f7ad1f1-13f8-40e9-9ea7-086db6619a15 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.216412 Oct 23 00:11:29.849048 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 253/502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:29 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:29.864592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:29.864820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:29.864820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:29.865019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f109c7fa-3ccb-406e-8b73-21aaa1cfc88c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.216795 Oct 23 00:11:29.865019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 250/503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:29 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:29.865188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.865188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.865188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.865188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:29.865535 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:29.865535 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:29.895877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:30.025601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:30.037416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ca861a45-2a86-4903-ac84-32628148d43e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.186764 Oct 23 00:11:30.038262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 254/504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:29 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:30.871337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:30.871942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:30.878376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:30.878852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:30.879360 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:30.879959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:30.880403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:30.880856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:30.883362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:30.883994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:30.891100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:30.891580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:30.892017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:30.892741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:30.893197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:30.893626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:31.085678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:31.094170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-083193bc-ad52-4ac1-997a-c4ea8f540732 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.225831 Oct 23 00:11:31.094751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 251/505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:30 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:31.098254 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:31.099765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:31.112040 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1fa32d15-8c78-4073-8827-dc0a70132e54 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.232741 Oct 23 00:11:31.112432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:31.113290 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 255/506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:30 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:31.119715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:31.120301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:31.120881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:31.121674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:31.122249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:31.122764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:31.258808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:31.267556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f4fca460-d096-4310-8c4e-693dfe879076 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.171599 Oct 23 00:11:31.268156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 252/507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:31 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:32.117619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:32.118824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:32.125907 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.126382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.126810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.127522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.127969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.128389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.137418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:32.138027 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:32.145213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.145696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.146162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.146845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.147296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.147721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.329142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:32.335753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:32.336850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d4673422-5a90-41bd-96d6-fced098cb50c tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.223095 Oct 23 00:11:32.337479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 256/508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:32 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:32.342759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:32.343927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:32.344225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e97a4a6f-f2d8-482f-ada4-a83d18f70bd3 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.210623 Oct 23 00:11:32.344820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 253/509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:32 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:32.349959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.350443 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.350872 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.351554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:32.352002 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:32.352441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:32.480362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:32.487865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49085ab5-229c-40e4-9a1b-bd62bff05ea1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.149136 Oct 23 00:11:32.488424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 257/510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:32 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:33.361418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:33.362032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:33.367184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:33.367786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:33.368462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.368978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.369418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.370113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.370565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.370993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.374099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.375198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.375649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.376336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.376811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.377381 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.561140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:33.569493 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5797e3f4-faf8-49bc-b0cb-02c90de3595b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.212539 Oct 23 00:11:33.569648 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:33.570068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 254/511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:33 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:33.575411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:33.576217 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:33.579310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-54d738d6-c912-4763-9aae-2e8d37618e93 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.215689 Oct 23 00:11:33.584027 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.584522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.584962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.585653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:33.586104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:33.586522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:33.590111 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 258/512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:33 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:33.716111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:33.724715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-68ab71c8-bfbf-48e8-995d-07ad6133521a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.153212 Oct 23 00:11:33.725289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 255/513] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:33 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:34.524214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e831dd3a-0eea-4767-9245-368552561dc1", "name": "network-vif-plugged", "status": "completed", "tag": "e10f00a2-91a8-4562-8948-fb8d00c26768"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:34.535591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.536079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.536532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.548823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] Creating event network-vif-plugged:e10f00a2-91a8-4562-8948-fb8d00c26768 for instance e831dd3a-0eea-4767-9245-368552561dc1 on hv-cinder-86156 Oct 23 00:11:34.553939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-7e473960-a492-4bdc-a48c-31fa3a02e5e3 req-1ba8e2a1-f601-43ab-9183-8612d627fe8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Oct 23 00:11:34.554711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 259/514] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:34.595458 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:34.596076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:34.603011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.603303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:34.603502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.603936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.604066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:34.604654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.605110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.605533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.610849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.611268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.611700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.612393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.612941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.613490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.823056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:34.823557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2ba7bf54-f383-46e9-afe8-44d26fe88aea tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.233133 Oct 23 00:11:34.836785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 256/515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:34 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:34.837104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:34.837308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:34.837308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:34.837622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.838300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.838747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.843792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:34.843792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:34.843792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:34.845179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c3ad49e2-bef7-4838-babb-8456c284fe2a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.245890 Oct 23 00:11:34.845909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 260/516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:34 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:34.977598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:34.985648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5a2b0d31-5433-4e28-ad9a-f54a833de71e tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.160538 Oct 23 00:11:34.986205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 257/517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:34 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:35.654866 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:35.655423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:35.661979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.662448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.662877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:35.663546 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.663990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.664404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:35.688062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3f78d11c-d387-4211-bfa9-6c385bb83018 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/ips" status: 200 len: 152 microversion: 2.20 time: 0.036253 Oct 23 00:11:35.688641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 261/518] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 23 00:11:35 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:11:35.853365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:35.853975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:35.862530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.863009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.863663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:35.864591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.865189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.865810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:35.880988 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:35.881926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:35.889050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.889704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.891120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:35.892111 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:35.892738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:35.893307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:36.099357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:36.099546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:36.109849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c086a01c-8994-4627-ae81-e49e463ae856 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1357 microversion: 2.1 time: 0.259917 Oct 23 00:11:36.110520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 258/519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:35 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:36.111932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5360dc13-3699-4033-be3d-f3717edd8937 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.234198 Oct 23 00:11:36.112709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 262/520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:35 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:36.115748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:36.116585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:36.123046 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:36.123710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:36.124319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:36.125886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:36.126489 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:36.127146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:36.256990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:36.264698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-72ea91ee-5c8a-414b-aa2c-5c1ed6fdf28d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.152949 Oct 23 00:11:36.266119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 259/521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:36 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:37.134996 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:37.135562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:37.135932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:37.136033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:37.142085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.142275 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.142594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.142750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.143037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.143180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.143890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.144038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.144336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.144698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.144805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.145132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.559810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:37.563468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:37.568158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d387b397-b484-4410-bb04-b4d36db118ea tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.436946 Oct 23 00:11:37.568762 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 260/522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:37 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:37.571687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f9bd590d-7f2e-4b50-9ef0-d2f327e82024 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1548 microversion: 2.1 time: 0.440500 Oct 23 00:11:37.573129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:37.573400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 263/523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:37 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1548 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:37.573725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:37.580441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.580945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.581374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.582099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.582547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.582970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.596659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:37.597274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:37.603524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.604008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.604445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.605376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.605836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.606260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.777782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:37.785443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-47323c2e-1c90-41cd-8d5b-d8c5f64b3172 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.215726 Oct 23 00:11:37.786016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 261/524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:37 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:37.789346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:37.796960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2ffb44bc-20b1-4ce3-b36b-a53f0c2dd6f6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1548 microversion: 2.1 time: 0.205148 Oct 23 00:11:37.797510 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 264/525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:37 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:37.818606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:37.823428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:37.824187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Searching by: {'deleted': False, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a'} {{(pid=118855) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 00:11:37.831306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.831782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.832215 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.832968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:37.833419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:37.833842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:37.922573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.multi_cell_list [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118855) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 00:11:38.020898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dc5eaa17-1416-4525-a834-a9f95d782bf2 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205844 Oct 23 00:11:38.021475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 262/526] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 23 00:11:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:38.033128 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:38.033678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:38.039683 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.040166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.040627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.041311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.041778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.042197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.174856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:38.182435 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-56cd5cc5-2a12-4e6a-839b-6146e7d872cc tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1548 microversion: 2.1 time: 0.153167 Oct 23 00:11:38.183024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 265/527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:38 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:38.591468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:38.592079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:38.600048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.600534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.600996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.601681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.602133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.602553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.698853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:38.699621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:38.706289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.706774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.707207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.707910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.708361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.708809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.733759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lazy-loading 'flavor' on Instance uuid 71d26bbe-0243-4653-9465-2afd08fcce15 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:11:38.737728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:38.745334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8ea046cc-6961-4367-b0a6-b43f60b5ede9 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.158049 Oct 23 00:11:38.745993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 263/528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:38 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:38.808126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:38.808860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:38.815277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.815766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.816200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.816941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.817388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.817808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.836286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:38.933967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4c49833f-2091-4f3c-bd03-deebd8b32b03 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/action" status: 202 len: 0 microversion: 2.20 time: 0.238839 Oct 23 00:11:38.934705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 266/529] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 00:11:38 2022] POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 00:11:38.943336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:38.944146 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:38.950699 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.951239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.951771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.953036 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:38.953490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:38.953995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:38.956618 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:38.964437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1afc1bb9-fad9-4034-90a5-b8177b291a2f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.160105 Oct 23 00:11:38.965226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 264/530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:38 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:39.143884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "name": "network-vif-plugged", "status": "completed", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:39.152030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:39.157979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.158494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.158927 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.162989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:39.164701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:39.166037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8ea1f025-9b2a-423b-8cc0-d4b8b594f6d1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.226819 Oct 23 00:11:39.170566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] Creating event network-vif-plugged:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:11:39.176945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-0b2b9bff-79bc-4700-a5c3-1c755f3c797d req-ce3cd11b-226b-4ac9-b396-5cbe0254f57a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Oct 23 00:11:39.177668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 265/531] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:39.181296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 267/532] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:38 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:11:39.773165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:39.774241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:39.774393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bf4bc04-2be0-47f5-971f-674f3f775c55"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:39.777207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:39.782217 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.782793 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.783230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.783929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.784250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.784368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.784778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.784888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.785200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.785888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.786378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.786802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.928564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:39.936059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c36fce5d-e656-48f3-b281-19447d9c6476 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.169423 Oct 23 00:11:39.936634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 266/533] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:39 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:39.988745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:39.989461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:39.995138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.995612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.996039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:39.996744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:39.997192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:39.997612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:40.126860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:40.135713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d2795b39-f56c-4bb1-9476-7ea9342eba8f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.150587 Oct 23 00:11:40.136671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 267/534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:39 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:40.153653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1042046370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1818066054", "security_groups": [{"name": "tempest-secgroup-smoke-244207915"}], "networks": [{"uuid": "0a4aa2c9-ff4c-4967-af0c-1ef6d6660599"}], "block_device_mapping_v2": [{"uuid": "9347d6e0-f498-4c28-96d2-c304504dc82a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:40.270125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] validate_networks() for [('0a4aa2c9-ff4c-4967-af0c-1ef6d6660599', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:11:40.634087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:11:40.634509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:11:40.634975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:11:40.635377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:11:40.635782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:11:40.645513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:40.645983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:40.646407 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:40.647116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:40.647563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:40.647981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:40.665204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Getting quotas for project 0401b24ace154000a2b9e80e785f1ce9. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:11:40.669034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Getting quotas for user cd59419dfebe46a28caad71b1454c53a and project 0401b24ace154000a2b9e80e785f1ce9. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:11:40.725937 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:11:40.728029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9347d6e0-f498-4c28-96d2-c304504dc82a',volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:11:40.861053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4587f0b0-8142-4c6d-a83a-60ae92d235b3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711157 Oct 23 00:11:40.867791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 268/535] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:11:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:11:40.867791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:40.867791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:40.872910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:40.873382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:40.873808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:40.875108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:40.876013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:40.876439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:41.019495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.027460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.028925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.030079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-227e9faa-c3a9-49a0-9fa2-9c4ac2601929 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.167318 Oct 23 00:11:41.031064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 269/536] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:40 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:41.034985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-aef65c50-61a3-416c-90e1-0755a1749db1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:41.036033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-aef65c50-61a3-416c-90e1-0755a1749db1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:41.089659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-aef65c50-61a3-416c-90e1-0755a1749db1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.097600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-aef65c50-61a3-416c-90e1-0755a1749db1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1089 microversion: 2.1 time: 0.065952 Oct 23 00:11:41.098627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 270/537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:41 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:41.103322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:41.104019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:41.111147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:41.111703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:41.112208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:41.113000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:41.113512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:41.114002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:41.257271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.265737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6de44c71-ac81-4991-b160-fd26cf75031c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.166057 Oct 23 00:11:41.266417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 271/538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:41 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:41.271418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:41.272030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:41.278100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:41.278583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:41.279014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:41.279702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:41.280155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:41.280766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:41.408347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:41.415932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f1b7cd63-13e9-4946-a2df-8d14dd7aa2e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.148392 Oct 23 00:11:41.416503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 272/539] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:41 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:42.055699 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:42.056329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:42.062752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.063232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.063668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.064348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.064825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.065246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.194718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.203248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.204700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.205845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2d49ada8-62a8-4bf5-84f6-58bfba04e9c1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.154143 Oct 23 00:11:42.206393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 273/540] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:42 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:11:42.210637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:42.211230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:42.216577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.217053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.217477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.218843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.219310 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.219588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.283318 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.290910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2464348b-6138-42dd-a0f5-149c52850e9a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1139 microversion: 2.1 time: 0.083574 Oct 23 00:11:42.291450 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 274/541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:42 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:42.295698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:42.296801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:42.302232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.302742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.303173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.303851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.304304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.304751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.432836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.441067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7e720e31-73bb-4ad9-acde-b3a23747c20c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.148683 Oct 23 00:11:42.441630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 275/542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:42 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:42.445971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:42.446561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:42.452022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.453254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.453695 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.454369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:42.454819 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:42.455238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:42.585241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:42.592931 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bc0e552c-d134-4009-bafb-1b15a47bb56a tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.150309 Oct 23 00:11:42.594144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 276/543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:42 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:43.232480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:43.233116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:43.239952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.240436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.240900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.241596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.242050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.242475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.396583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.409982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.412749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.414869 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0b9bc017-5bb2-4fca-8ad1-c595f3796239 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.186635 Oct 23 00:11:43.415905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 277/544] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:43 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:43.422482 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:43.423086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:43.430489 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.430971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.431404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.432091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.432591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.433021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.493041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.501441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1d1c3dde-699a-49a7-8fba-389ecd47b5a0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1139 microversion: 2.1 time: 0.083968 Oct 23 00:11:43.502013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 278/545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:43 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:43.506533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:43.507133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:43.512733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.513219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.513653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.514340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.514797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.515744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.643964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.651606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4ab09d48-9479-4360-b1c5-1eaf5dfe590d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.148492 Oct 23 00:11:43.652114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 279/546] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:43 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:43.656479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:43.657099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:43.662510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.662988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.663419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.664131 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:43.664613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:43.665038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:43.795979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:43.804295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d4578f87-2c93-4bd3-a0b8-c3d3ad7ea457 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.151209 Oct 23 00:11:43.804899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 280/547] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:43 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:44.442051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:44.442669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:44.449376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.449858 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.450294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.451012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.451463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.451914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.577247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.586106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.587547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.588738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-626a7ef8-37c9-4ca5-a915-d1ce05f84344 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.150631 Oct 23 00:11:44.589292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 281/548] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:44 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:11:44.593871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:44.594472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:44.600925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.601405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.601838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.602540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.602994 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.603411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.667859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.675579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-be489935-3bb4-441d-ab71-c2ce45a8f478 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1139 microversion: 2.1 time: 0.085344 Oct 23 00:11:44.676138 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 282/549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:44 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:44.680449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:44.681075 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:44.686450 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.687421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.687855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.688552 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.689004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.689422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.707715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:44.819582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.827115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fd37183d-7375-4910-9d88-977da6e0b89c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1314 microversion: 2.1 time: 0.150023 Oct 23 00:11:44.828687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 283/550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:44 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:44.833002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:44.833593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:44.835148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:44.840235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.840742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.841176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.841851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:44.842301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:44.842720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:44.974804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:44.982461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c50bb60b-0078-42b7-8a69-275e3a336d70 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.152831 Oct 23 00:11:44.983022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 284/551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:44 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:45.614895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:45.615525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:45.621899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.622460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.622897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:45.623583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.624034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.625186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:45.761853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:45.774644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:45.776664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:45.777835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b9aedf80-9e4a-41d0-9206-8b088f1e7c42 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.166908 Oct 23 00:11:45.778728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 285/552] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:45 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:11:45.794639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:45.795257 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:45.802448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.802930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.803363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:45.804048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.804532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.804940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:45.883490 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:45.892186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d674606e-58f7-4a02-88a2-7ed0ee34cf62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1139 microversion: 2.1 time: 0.112463 Oct 23 00:11:45.892806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 286/553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:45 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1139 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:45.897583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:45.898319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:45.904306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.904896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.905336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:45.906076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:45.906569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:45.907056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.048108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:46.055822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8ab5a1ae-41b9-4a7c-be6b-b2e388355ed6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1497 microversion: 2.1 time: 0.162078 Oct 23 00:11:46.056393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 287/554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:45 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:46.060761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:46.061384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:46.067247 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.067734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.068174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.068968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.069428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.069857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.208378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:46.216002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e85af621-c77a-4fad-91c3-fb26a965de1f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.158652 Oct 23 00:11:46.216579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 288/555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:46 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:46.435624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:46.446426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b98c86c7-3111-4932-a7d1-88e77f67d390 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.676975 Oct 23 00:11:46.447024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 268/556] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:11:39 2022] POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments => generated 194 bytes in 6679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:11:46.803371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:46.803903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:46.810251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.810729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.811161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.812524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.813057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.813239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.916619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:46.917316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:46.919333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=70 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:46.926147 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.926541 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.926970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.928297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:46.928772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:46.929193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:46.943880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:46.951938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:46.953951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:46.955102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8bfb4dcb-15ae-4548-8d93-2278a0c69416 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.155673 Oct 23 00:11:46.955652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 289/557] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:46 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:46.995963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:47.004621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3f3858dd-8e2d-421c-96d4-89c2d6b1cbf1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1131 microversion: 2.1 time: 0.093021 Oct 23 00:11:47.005198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 269/558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:46 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1131 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:47.240264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:47.240904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:47.246905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:47.247382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:47.247828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:47.248520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:47.248965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:47.249822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:47.379773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:47.387350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d19f296c-16e5-4e11-ac42-767c11c641ca tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.150931 Oct 23 00:11:47.387918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 290/559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:47 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:47.980910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:47.981529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:47.988794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:47.989267 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:47.989696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:47.990374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:47.990821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:47.991238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:48.026879 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:48.027747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:48.035339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:48.036053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:48.036693 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:48.037405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:48.037864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:48.038299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:48.113658 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:48.121270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-145c2b61-b308-4e3d-bbc2-f61a2658cbcc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1131 microversion: 2.1 time: 0.098139 Oct 23 00:11:48.121837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 291/560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:48 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1131 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:48.147882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:48.155971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:48.157452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:48.158600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-22ce4528-a560-43ab-8bff-9c28bfd808d0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.181518 Oct 23 00:11:48.159154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 270/561] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:47 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:48.412544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:48.413147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:48.419025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:48.419497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:48.419930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:48.420636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:48.421086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:48.422604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:48.549608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:48.557168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e8d8fe63-adfc-4f61-9c9e-ebe4f7b50441 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1370 microversion: 2.1 time: 0.148515 Oct 23 00:11:48.557731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 292/562] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:48 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:49.144932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:49.145569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:49.152059 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.152571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.153012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.153700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.154158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.154586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.183301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:49.183962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:49.191107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.191667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.192323 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.193000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.193529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.194030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.215262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:49.223263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-98a92bc4-a48e-49d1-a68d-d1a1823eddd3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1131 microversion: 2.1 time: 0.082636 Oct 23 00:11:49.223820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 271/563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:49 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:49.329370 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:49.338024 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:49.339476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:49.340651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-69ee3193-80d6-424d-bda6-313618f303fa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.161309 Oct 23 00:11:49.341209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 293/564] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:49 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:11:49.579412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:49.579934 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:49.585837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.586314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.586746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.587427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.587876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.588297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.719112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:49.727782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-695a3ff7-c12b-453e-8a7a-de63e208ece6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1563 microversion: 2.1 time: 0.152507 Oct 23 00:11:49.728342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 272/565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:49 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:49.750355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:49.751033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:49.756810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.757280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.757708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.758380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:49.758828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:49.759250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:49.834717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cdbf9e6e-dc5c-4a84-addf-59e5f3cb41c8 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088064 Oct 23 00:11:49.835310 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 294/566] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:11:49 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:50.246065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:50.246658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:50.252769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:50.253415 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:50.253827 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:50.254509 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:50.254961 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:50.255383 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:50.336514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:50.344933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c949a56b-7348-404a-b18c-506dd80b10a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1131 microversion: 2.1 time: 0.102140 Oct 23 00:11:50.345531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 273/567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:50 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1131 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:50.367603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:50.368337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:50.374419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:50.374979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:50.375514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:50.376284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:50.376841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:50.377337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:50.611103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:50.619286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:50.620786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:50.621960 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-592bae13-5705-4183-8a34-6f432d7fb4c0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.258929 Oct 23 00:11:50.622521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 295/568] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:50 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:51.110454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:51.120379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.121182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.121619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.138868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] Creating event network-changed:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:11:51.144554 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-21b1c032-3d12-4166-8875-5f226aef786f req-8d825c7c-5b93-4f59-bc23-3e28785dad8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038177 Oct 23 00:11:51.145227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 274/569] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:51.368697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:51.369306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:51.371117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=4 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:51.372255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=8 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:51.379007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.379499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.379971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.380764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.381220 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.381651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.443029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:51.450709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-222d92b4-406a-438b-9a44-4902dd6474a4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.085779 Oct 23 00:11:51.451209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 296/570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:51 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:51.648257 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:51.648977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:51.655718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.657628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.658336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.659607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.660591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.661472 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.809539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:51.811032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:51.825387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.826111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.826524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.827479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:51.828086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:51.829130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:51.900280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:11:51.995613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-36600a85-ce47-474e-b2d8-5a47082a3cdd tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 204 len: 0 microversion: 2.1 time: 0.188410 Oct 23 00:11:51.996582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 297/571] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:11:51 2022] DELETE /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 00:11:52.006303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:52.007005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:52.013834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:52.014330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:52.014930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:52.015618 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:52.016310 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:52.016760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:52.030603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:52.042326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:52.044005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:52.045505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4d61c800-113c-4979-b9bd-0d785609e3d5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.401483 Oct 23 00:11:52.046533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 275/572] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:51 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:52.183940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:52.189207 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:52.197303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-aba6102d-f110-40d9-91b8-9eccf2a2e9a6 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.195630 Oct 23 00:11:52.197989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 298/573] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:51 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:52.474368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:52.475276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:52.481890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:52.482371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:52.482811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:52.483500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:52.483957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:52.484382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:52.544789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:52.552751 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fa5dd789-e799-4b1b-8392-b0d6398d90a5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.083139 Oct 23 00:11:52.553314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 276/574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:52 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:53.071430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:53.072030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:53.080106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.080673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.081106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.081785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.082230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.082645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.212200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:53.220340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:53.220745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:53.221360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:53.221825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:53.222988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4fcda304-f148-4304-9c25-20b287bf0bb6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.155466 Oct 23 00:11:53.223799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 299/575] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:53 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:53.227623 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.228099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.228580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.229263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.229855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.230305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.362187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:53.370202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-02497a08-e26a-4ed2-97f5-d10bd2176eec tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.153452 Oct 23 00:11:53.370779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 277/576] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:53 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:53.574688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:53.575231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:53.581499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.581987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.582423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.583110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:53.583568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:53.583996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:53.644868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:53.652411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2f586162-ea0e-4b93-b484-3e3ac227afa6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.081591 Oct 23 00:11:53.653000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 300/577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:53 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:54.249157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:54.249762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:54.256900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.257377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.257809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.258492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.258944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.259401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.387035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:54.395199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:54.395808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:54.398627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:54.400101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:54.401294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-24b165bd-0e42-4b75-8851-79530267e123 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.156003 Oct 23 00:11:54.408911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 278/578] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:54 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:54.409086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.409086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.409086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.409086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.409470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.409470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.537232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:54.544729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0faa659f-be7a-4436-bc2f-83a7fe78b080 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.153975 Oct 23 00:11:54.545284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 301/579] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:54 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:54.675795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:54.676395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:54.682370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.682848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.683277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.683965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:54.684412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:54.684855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:54.744689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:54.752816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49829b2b-ed7c-4317-afc4-85fa34938e33 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.081606 Oct 23 00:11:54.753376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 279/580] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:54 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:55.427348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:55.427982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:55.434123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.434601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.435033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.435717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.436169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.436616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.567855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:55.568357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:55.569003 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:55.575287 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.575761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.575939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:55.576193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.576905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.577357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.577455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:55.577781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.578595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-882da696-7311-4032-aff8-7c13d41e0a32 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.155143 Oct 23 00:11:55.579963 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 302/581] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:55 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:55.710792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:55.718278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5e9f3403-423e-45b5-b934-7588e2fc886d tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.153801 Oct 23 00:11:55.718835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 280/582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:55 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:55.775405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:55.776009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:55.781966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.782550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.782990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.783672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:55.784124 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:55.784566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:55.845600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:55.853338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-90657ecf-ab09-4e5a-966f-3a439b28241c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.081840 Oct 23 00:11:55.853901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 303/583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:55 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:56.603893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:56.604507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:56.611631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.612115 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.612578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.613264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.613715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.614136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.742784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:56.743591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:56.750152 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.750750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.751460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.751994 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.752569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.752996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.784856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:56.792960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:56.794415 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:56.795593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b20dba6c-8990-424e-b214-a4e38bbeb5a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.195494 Oct 23 00:11:56.796158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 281/584] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:56 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:56.875650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:56.876570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:56.882659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.883141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.883578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.884618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:56.884895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:56.885322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:56.886733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:56.894930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5157693a-2f8c-42b5-ac61-c915f6d2d96c tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.156167 Oct 23 00:11:56.904372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 304/585] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:56 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:56.947661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:56.956323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fae9131e-7589-4c2a-85ab-85e1e3f4b1bb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1187 microversion: 2.1 time: 0.084856 Oct 23 00:11:56.956959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 282/586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:56 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:57.822922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:57.823539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:57.829919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:57.830617 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:57.831056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:57.831753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:57.832363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:57.832976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:57.919701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:57.921351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:57.930362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:57.931358 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:57.931919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:57.932773 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:57.933447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:57.934032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:58.033644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:58.042067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:58.043947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:58.045377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d41afbce-9fbb-4d5f-91b4-db2a4fb4d55a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.227185 Oct 23 00:11:58.046187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 305/587] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:57 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:58.051264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:58.052117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:58.058474 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:58.059238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:58.060099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:58.061050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:58.062197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:58.062843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:58.104516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:58.114781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d7a3244c-5087-4a3c-879c-56a82b873da2 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1503 microversion: 2.1 time: 0.199386 Oct 23 00:11:58.115450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 283/588] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:57 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:58.222522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:58.231147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bb763645-4292-4034-9b39-5eaf48632a51 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.183747 Oct 23 00:11:58.232791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 306/589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:58 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:11:58.553556 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:58.566282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:58.567169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:58.567169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:58.589444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] Creating event network-changed:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:11:58.596507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-fe5f8ede-8170-4d80-8de0-dbd93ae24f2f req-4c24b1ee-bf54-4050-8941-78132b9e8037 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046459 Oct 23 00:11:58.597526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 284/590] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:58.770703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e831dd3a-0eea-4767-9245-368552561dc1", "name": "network-vif-deleted", "tag": "e10f00a2-91a8-4562-8948-fb8d00c26768"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:11:58.780981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:58.780981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:58.781441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:58.793685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] Creating event network-vif-deleted:e10f00a2-91a8-4562-8948-fb8d00c26768 for instance e831dd3a-0eea-4767-9245-368552561dc1 on hv-cinder-86156 Oct 23 00:11:58.799527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-ca9d5502-b8b9-4d05-a2ab-a807ecda1c62 req-4a6a0773-a103-4e90-bd9d-9af921f99872 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Oct 23 00:11:58.800127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 307/591] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:11:59.072139 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:59.072849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:59.080413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.080922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.081384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.082125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.082578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.082997 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.139394 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:59.140146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:59.147295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.148079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.148602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.149516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.150176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.150831 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.186189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.187449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.188928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.189760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lazy-loading 'fault' on Instance uuid e831dd3a-0eea-4767-9245-368552561dc1 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:11:59.254469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63286ecd4376471f8ab5f647674eaf43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcef7335dafe4b29960c12ce5ab5330b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:59.258279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:59.263000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d130ef8a-34ae-44ab-aff9-4140ffadc2e7 tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 200 len: 1304 microversion: 2.1 time: 0.128263 Oct 23 00:11:59.263588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 308/592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:59 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:11:59.269093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:11:59.269927 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:11:59.271984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:59.273650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:59.275146 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-20ac3e12-05e8-4713-8c98-35619c7bbd39 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.207288 Oct 23 00:11:59.275981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 285/593] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:11:59 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:11:59.277035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.277520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.277953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.278644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:11:59.279104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:11:59.279523 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:11:59.412120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:11:59.420318 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dc29d8b7-c15d-4798-8931-0833de44bcfb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.155433 Oct 23 00:11:59.420852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 309/594] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:11:59 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:00.287778 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:00.288393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] [instance: e831dd3a-0eea-4767-9245-368552561dc1] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:00.294882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.295372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.295837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.296551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.297010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.297522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.300725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:00.301333 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:00.307636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.308169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.308715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.309397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.309842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.310259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.311529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] HTTP exception thrown: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Request method failure captured: Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 HTTP/1.1 Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIZV2FRJQvddak5zL2xPsm0QWh1CybUYf7GBu8jpq1twnjETE-6KLqTzHw_Dv4waCkIVVRYHR_-4HNmScz4jyy9oKWBOXLn7J6Cwieu_QndUuTd0gDqv4CjNs22QLO9YWl2VrdBcP4GA4OgIOCkCmPFvZlYUVq3-ZdLa03dsyT5yiSk Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: bcef7335dafe4b29960c12ce5ab5330b Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesActionsTest-1403877354 Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:12:00.313695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bcef7335dafe4b29960c12ce5ab5330b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bcef7335dafe4b29960c12ce5ab5330b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesActionsTest-1403877354 Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: bcef7335dafe4b29960c12ce5ab5330b Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesActionsTest-1403877354 Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesActionsTest-1403877354-project Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 63286ecd4376471f8ab5f647674eaf43 Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesActionsTest-1403877354-project Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. Oct 23 00:12:00.315335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'e831dd3a-0eea-4767-9245-368552561dc1'} Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:12:00.316084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. Oct 23 00:12:00.317671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:00.320583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] Returning 404 to user: Instance e831dd3a-0eea-4767-9245-368552561dc1 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:12:00.320583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b15188fa-0e70-45d6-9318-0245357ce34a tempest-VolumesActionsTest-1403877354 tempest-VolumesActionsTest-1403877354-project] 10.222.0.13 "GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1" status: 404 len: 111 microversion: 2.1 time: 0.032234 Oct 23 00:12:00.320583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 286/595] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:00 2022] GET /compute/v2.1/servers/e831dd3a-0eea-4767-9245-368552561dc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:12:00.445086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:00.446081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:00.452319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.452844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.453278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.454577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:00.455033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:00.455454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:00.456981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:00.466472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:00.467905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:00.469103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0b0ea0ed-0f1c-4096-b721-9ffd4538de7d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.172539 Oct 23 00:12:00.470551 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 310/596] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:00 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:00.475457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:00.594308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:00.603709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5aeb6c67-be3e-4db9-ac6f-9ab60813d27e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.162809 Oct 23 00:12:00.604278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 287/597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:00 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:01.496431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:01.497073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:01.504125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.504631 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.505064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:01.505754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.506210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.506614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:01.628742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:01.630233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:01.637449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.637933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.638369 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:01.639067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.639165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:01.639522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.639946 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:01.648104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:01.649665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:01.650941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4efe2b5b-fd88-4e92-9a04-d63bbd94e363 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.158324 Oct 23 00:12:01.651570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 311/598] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:01 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:01.776342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:01.785637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-920e1621-74b2-4848-bcb9-ad1498db8b63 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.162215 Oct 23 00:12:01.786215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 288/599] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:01 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:01.893779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:01.894306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:01.900165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.900689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.901129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:01.901813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:01.902268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:01.902692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:02.030885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lazy-loading 'services' on Instance uuid 5c513ed3-7e00-4e46-be58-572838fb4eae {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:12:02.291052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dbdf7467-5c8a-4af8-a1e5-4e593356a4b4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae/os-volume_attachments/c60a58cc-a812-4adf-a436-b8a7a9790881" status: 202 len: 0 microversion: 2.1 time: 0.401104 Oct 23 00:12:02.291647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 312/600] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:12:01 2022] DELETE /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae/os-volume_attachments/c60a58cc-a812-4adf-a436-b8a7a9790881 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:12:02.677017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:02.677543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:02.683984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:02.684462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:02.684938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:02.685619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:02.686070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:02.686534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:02.809962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:02.810722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:02.817157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:02.817675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:02.818159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:02.818595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:02.819291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:02.819743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:02.820167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:02.825523 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:02.826982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:02.828123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7ba1868c-0156-46b5-9642-24e067476254 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.155084 Oct 23 00:12:02.828721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 289/601] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:02 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:02.953960 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:02.961540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d73d1a62-f357-4f58-9cac-c5f1689786cd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.156226 Oct 23 00:12:02.962107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 313/602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:02 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:03.854715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:03.855356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:03.862363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:03.862846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:03.863287 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:03.863971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:03.864430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:03.864888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:03.983941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:03.984574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:03.992077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:03.992582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:03.993016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:03.993393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:03.993728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:03.994364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:03.994804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:04.001481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:04.002926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:04.004082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-55ab0b39-8c80-456e-b98e-3615be0250d3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.153609 Oct 23 00:12:04.004663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 290/603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:03 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:04.124855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:04.132579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f6f7e1a9-285f-47fe-9d22-c093ca7f7d90 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.152460 Oct 23 00:12:04.133141 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 314/604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:03 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:05.029104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:05.029710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:05.036614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:05.037091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:05.037521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:05.038195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:05.038649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:05.039076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:05.154669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:05.155325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:05.161610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:05.162085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:05.162511 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:05.163195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:05.163928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:05.164347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:05.168356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:05.173658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:05.183153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:05.184407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:05.185858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49aac2fb-17e6-47c1-8870-ccf39b6912da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.160637 Oct 23 00:12:05.186419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 291/605] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:05 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:05.296758 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:05.304853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dbafd1d8-50ec-417c-a1bf-9aec75bf27fe tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.153986 Oct 23 00:12:05.305413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 315/606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:05 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:06.212608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:06.213285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:06.220585 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:06.221079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:06.221516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:06.222210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:06.222784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:06.223168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:06.327279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:06.328002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:06.334998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:06.335596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:06.336098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:06.336882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:06.337420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:06.337908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:06.364004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:06.372272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:06.373741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:06.374897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e31ee382-bf98-43e8-a597-3840fec496eb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.166191 Oct 23 00:12:06.375462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 292/607] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:06 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:06.470525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:06.478696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3fc460c5-3fa8-4cf8-bafa-ab4606dbb1c9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.155367 Oct 23 00:12:06.479276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 316/608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:06 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:07.398992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:07.399626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:07.406013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.406487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.406956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:07.407634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.408080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.408522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:07.501856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:07.502440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:07.508894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.509374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.509805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:07.510496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.510943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.511363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:07.545070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:07.554336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:07.555779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:07.557113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8c30d736-43fe-4c6d-b2bd-98cd3f9c130d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.162101 Oct 23 00:12:07.557914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 293/609] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:07 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:07.678186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:07.686520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d6c981af-7f2f-4ce2-a74b-54df992846d8 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1272 microversion: 2.1 time: 0.189012 Oct 23 00:12:07.687100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 317/610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:07 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:07.929949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:07.930583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:07.936889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.937868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.938710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:07.939626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:07.940279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:07.940914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:08.093980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:08.111408 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-853bdb31-6848-438a-bda5-5107c46ec724 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1594 microversion: 2.1 time: 0.179045 Oct 23 00:12:08.113475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 294/611] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:07 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1594 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:08.583878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:08.585461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:08.592404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:08.593281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:08.593950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:08.596549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:08.597239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:08.597884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:08.715679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:08.717642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:08.727973 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:08.729007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:08.729980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:08.731516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:08.732834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:08.733413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:08.962694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:08.979472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:08.982645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:08.984777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-43d49b0b-c87b-4a92-88c4-3e9f266c9879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.405009 Oct 23 00:12:08.992898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 318/612] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:08 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:09.012074 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:09.022946 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e4087dfb-23bf-4738-9efe-365a3cb96fed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.313163 Oct 23 00:12:09.032007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 295/613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:08 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:10.015629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:10.017083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:10.024643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.025385 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.025990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.026858 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.027298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.027877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.046983 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:10.048600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:10.058799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.059552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.063742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.064701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.065337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.066044 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.639624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:10.654290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:10.656372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:10.658992 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fc530bb4-47b8-4a7e-b5d1-8e3250d5b296 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.646996 Oct 23 00:12:10.659678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 319/614] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:10 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:10.676660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:10.693242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-202b56c3-ab22-417c-b8ee-bc5151bafccc tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.649930 Oct 23 00:12:10.710363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 296/615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:10 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:10.939064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:10.939562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:10.946444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.946939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.947378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.948091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:10.948576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:10.949198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:10.989095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:12:11.119079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:11.135873 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.136356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.136816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.151887 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] Creating event network-changed:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:12:11.162168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-2e103ba4-5fc7-46f9-a011-879cdd48bcaf req-aec8d095-98e0-4fb0-9c63-b4d61622739c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054388 Oct 23 00:12:11.163814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 297/616] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:11.180785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-be77b540-a8f6-494d-a4b1-abf90b266ff9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 204 len: 0 microversion: 2.1 time: 0.244822 Oct 23 00:12:11.181877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 320/617] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:12:10 2022] DELETE /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:12:11.194654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:11.195489 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:11.204782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.205841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.206386 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.207768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.208394 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.208952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.465365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:11.496113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9f6e160e-3adf-47f0-8abd-12da750e159d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1515 microversion: 2.1 time: 0.308177 Oct 23 00:12:11.497184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 298/618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:11 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:11.690146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:11.696010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:11.706520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.707200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.707816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.708697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.709484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.710077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.716290 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:11.717156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:11.727037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.732776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.737101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:11.739769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:11.744580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:11.745392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:12.082716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:12.099925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:12.101401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:12.112578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e5bd58ed-ba80-41b7-bf0f-21fcb62403df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.431588 Oct 23 00:12:12.114516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 321/619] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:11 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:12.119308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:12.130028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dd95d776-1a90-47ad-bb40-c6fef6a68fef tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.417351 Oct 23 00:12:12.133367 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 299/620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:11 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:12.525601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:12.527364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:12.539007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:12.540122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:12.541153 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:12.542315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:12.543198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:12.544321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:12.728661 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:12.731220 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-723572091"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:12.731788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:12.738398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a4fde49c-c985-4939-ba95-930d16dd38c6 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1515 microversion: 2.1 time: 0.218687 Oct 23 00:12:12.738568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:12.739015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:12.739607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:12.739740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 322/621] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:12 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:12.740306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:12.741093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:12.741531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:12.898853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.network.security_group_api [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Adding security group e716dc17-d7d7-4e27-8455-88f9c85f94a6 to port 1ee74db1-8e09-4822-921d-2ca859c0ee09 Oct 23 00:12:13.138468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:13.139490 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:13.150170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.151238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.151993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.152933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.153791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.154428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.347733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7406b022-2561-4363-b6b7-7c455b50ed32 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action" status: 202 len: 0 microversion: 2.1 time: 0.620773 Oct 23 00:12:13.352095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 300/622] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:12:12 2022] POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:12:13.355981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:13.357102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:13.380272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.380795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.381261 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.381949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.382403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.382827 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.611836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:13.620338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:13.634360 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:13.635560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-10bf714b-d94b-4f98-ae11-219b6ff972dd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.501044 Oct 23 00:12:13.636707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 323/623] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:13 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:13.643063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:13.643940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:13.653044 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:13.661850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ad14a012-f4a5-4057-b3ae-24b649e3c2b0 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.311275 Oct 23 00:12:13.664913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.665410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.665659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 301/624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:13 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:13.666197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.667634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.671452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:13.680533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.681365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.682781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.683457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.684047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.697631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] Creating event network-changed:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:12:13.704542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-682a2233-34f6-4dcb-8704-7520e84ee29e req-d25fb2d6-9381-4dfb-baad-46bcb860420a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Oct 23 00:12:13.710159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 302/625] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:13.770693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:13.772102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:13.795884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.798448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.801540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.802557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:13.804749 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:13.806124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:13.924525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:13.938776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-29984810-d138-4e04-a275-e82f9174719a tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1640 microversion: 2.1 time: 0.300752 Oct 23 00:12:13.939685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 324/626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:13 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1640 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:14.019729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:14.031578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9cded356-895d-4a75-a90e-076957139e24 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1515 microversion: 2.1 time: 0.269202 Oct 23 00:12:14.035380 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 303/627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:13 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:14.665668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:14.666279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:14.677689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:14.678337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:14.683477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:14.685182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:14.685819 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:14.686605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:14.697703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:14.698292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:14.706272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:14.706940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:14.707550 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:14.708398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:14.709015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:14.709626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:14.995446 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:15.008343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-22664088-73b5-4af1-b947-08f30747028d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.314348 Oct 23 00:12:15.010130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 304/628] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:14 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:15.040050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:15.050163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:15.051623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:15.052852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ccb1e72f-5c86-45ca-8b05-9fd7b92d108b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.391690 Oct 23 00:12:15.053423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 325/629] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:14 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:15.060768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:15.061773 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:15.069342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:15.069841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:15.070286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:15.070995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:15.071456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:15.072315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:15.250306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:15.255498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:15.279697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-dca3e987-b525-4598-8661-c200f8e87fa9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1473 microversion: 2.1 time: 0.222714 Oct 23 00:12:15.280329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 305/630] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:15 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:15.721866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c513ed3-7e00-4e46-be58-572838fb4eae", "name": "network-vif-deleted", "tag": "6a22a4da-def7-49ce-bbfb-af423b29e223"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:15.727534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:15.733768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:15.734530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:15.735817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:15.748348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] Creating event network-vif-deleted:6a22a4da-def7-49ce-bbfb-af423b29e223 for instance 5c513ed3-7e00-4e46-be58-572838fb4eae on hv-cinder-86156 Oct 23 00:12:15.755531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-61e0a266-f1e5-49ed-9105-489aa99ac5cf req-f989278b-6d5a-41d9-b3de-3828de0f563d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037863 Oct 23 00:12:15.756133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 326/631] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:16.035657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:16.036960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:16.043274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.043750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.044181 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.044892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.045564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.046189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.082740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:16.083817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:16.090354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.091144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.091806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.092756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.093423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.094097 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.320159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:16.329532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-87630bf6-5273-442b-92ea-d92031ed794b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.298275 Oct 23 00:12:16.331165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 306/632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:16 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:16.337412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:16.338315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:16.344807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.345670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.346359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.347272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:16.347940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:16.348604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:16.354258 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:16.365718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:16.372127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:16.373667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7fda4d77-94f0-407f-92cc-889d2bb40f36 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.295980 Oct 23 00:12:16.374245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 327/633] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:16 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:16.432737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:16.442178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9894d7e7-02ec-4f29-a482-d650e4be8e1d tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1473 microversion: 2.1 time: 0.109752 Oct 23 00:12:16.456920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 307/634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:16 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1473 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:17.354985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:17.355729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:17.369042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.370062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.370827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.371717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.373091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.373957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.404010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:17.405876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:17.412456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=78 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:17.415571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.416337 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.417035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.417963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.418670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.419306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.661351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:17.672342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-304a830c-e1bf-4014-9fa1-caad37b95dbd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.320962 Oct 23 00:12:17.674656 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 328/635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:17 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:17.681139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "name": "network-vif-plugged", "status": "completed", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:17.693499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.694251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.695038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.710304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] Creating event network-vif-plugged:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:12:17.716251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-c7bc0222-ddef-4f33-9619-a29dd5fccc5d req-b98c7386-c2dd-4c04-86ec-ced215421352 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039083 Oct 23 00:12:17.723075 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 329/636] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:17.729255 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:17.730157 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:17.738532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.739326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.739802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.740530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.740976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.741530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.775163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:17.785806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:17.787957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:17.789491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e356eed5-2e70-4da9-9811-2570b3171fc5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.390146 Oct 23 00:12:17.790621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 308/637] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:17 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:17.791476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:17.791983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:17.792428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:17.792910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lazy-loading 'fault' on Instance uuid 5c513ed3-7e00-4e46-be58-572838fb4eae {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:12:17.854853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:17.864765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8f306d3f-8ccf-4db8-89b0-d5ee4d05dbeb tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 200 len: 1309 microversion: 2.1 time: 0.139933 Oct 23 00:12:17.865704 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 330/638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:17 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:18.697602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:18.698513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:18.706177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.706761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.707271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.708046 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.708712 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.709211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.816085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:18.816744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:18.823593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.824084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.824543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.825241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.825694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.826118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.832248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:18.865114 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:18.873340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9659d49b-940f-4031-8801-b006397ca135 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.179640 Oct 23 00:12:18.888869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 309/639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:18 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:18.896015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:18.896893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 5c513ed3-7e00-4e46-be58-572838fb4eae] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:18.903338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.904058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.904704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.905582 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:18.906029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:18.906451 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:18.920911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] HTTP exception thrown: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Request method failure captured: Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae HTTP/1.1 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIZnw6YJSCokGX0PrA_jkWj_81BnsFH3HrbYZrXADPr2oE1fgX-nD_PjbigGZ9eqdcqPFyFV-t7HUl4DQpuGrWvga1rgnJ6tD_G6ZenN4K6SVhtjdfjEBXATevaBWUcNXfK3r66_Ia_z37U0_2h4HICHUZPOTocxDj9ZNzsF13p-Io4 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: a199c36a2f054a03ae399ace011c3c95 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:12:18.922688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a199c36a2f054a03ae399ace011c3c95", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: a199c36a2f054a03ae399ace011c3c95 Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesSnapshotTestJSON-494041477-project Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 0675f7444e544220b53a34dd3086edc5 Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesSnapshotTestJSON-494041477-project Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. Oct 23 00:12:18.924498 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '5c513ed3-7e00-4e46-be58-572838fb4eae'} Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:12:18.925471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. Oct 23 00:12:18.926980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:12:18.928085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Returning 404 to user: Instance 5c513ed3-7e00-4e46-be58-572838fb4eae could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:12:18.928085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cd300d61-dbb6-4f2b-8279-d961d0a026dc tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae" status: 404 len: 111 microversion: 2.1 time: 0.034055 Oct 23 00:12:18.928558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 310/640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:18 2022] GET /compute/v2.1/servers/5c513ed3-7e00-4e46-be58-572838fb4eae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:12:18.995260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:19.004737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:19.006198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:19.007422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cc06bec5-4cb3-41e9-a8d6-b77286420d2f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.195538 Oct 23 00:12:19.007983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 331/641] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:18 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:19.902169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:19.902815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:19.910580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:19.911078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:19.911516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:19.912310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:19.912797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:19.913414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:20.038343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:20.039171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:20.045555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:20.046283 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:20.046870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:20.049106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:20.049730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:20.050326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:20.061050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:20.076959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1d72eecb-371e-42af-9f08-1969cc1fd2ed tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.178925 Oct 23 00:12:20.078209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 311/642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:19 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:20.216030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:20.224822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:20.229349 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:20.230644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-512d102d-b9cb-4d00-aa14-44cdda034544 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.196263 Oct 23 00:12:20.231295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 332/643] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:20 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:21.101911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:21.102618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:21.110904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:21.111395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:21.111831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:21.112563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:21.113035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:21.113982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:21.257942 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:21.258865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:21.267571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:21.268316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:21.269204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:21.270324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:21.270784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:21.271213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:21.273071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:21.284799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a0d83867-44a4-4c54-92e2-1ece8f4af6d1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.187088 Oct 23 00:12:21.285705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 312/644] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:21 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:21.424910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:21.433284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:21.434741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:21.435901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-28af9537-7bda-450d-9e4c-05bb3b3bc347 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.182357 Oct 23 00:12:21.436657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 333/645] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:21 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:22.308823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:22.309592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:22.316662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:22.317426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:22.317889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:22.318774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:22.319428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:22.320071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:22.471659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:22.480096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:22.486025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:22.493120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c2e24dd5-9e66-4518-8093-bff512035c93 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.188140 Oct 23 00:12:22.493701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 313/646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:22 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:22.496902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:22.497736 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:22.498280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:22.499088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:22.499648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:22.500175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:22.693437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "name": "network-vif-plugged", "status": "completed", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:22.708425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:22.709124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:22.709728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:22.714032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:22.723627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:22.725404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:22.726861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bc080ca3-33af-4be3-9ff7-db2ba92df4aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.267699 Oct 23 00:12:22.736600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] Creating event network-vif-plugged:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:12:22.745980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-70e45fa9-8ee8-4483-ae27-09933f580446 req-6a471894-f22d-4480-b7cc-eb9cbd788de8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057354 Oct 23 00:12:22.746572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 314/647] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:22.747816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 334/648] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:22 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:23.516967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:23.517741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:23.525043 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:23.525520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:23.525951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:23.526633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:23.527077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:23.527594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:23.682949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:23.692111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c11a91b6-8fbf-4017-85bb-749750ee9de5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.179941 Oct 23 00:12:23.707829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 335/649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:23 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:23.756900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:23.758374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:23.767503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:23.767938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:23.768559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:23.769518 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:23.770167 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:23.771001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:23.933141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:23.942121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:23.944025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:23.945502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2552fa13-f83b-406f-93e8-47ec1ff6a234 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.193778 Oct 23 00:12:23.957026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 315/650] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:23 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:24.716202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:24.718009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:24.728436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:24.729199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:24.729975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:24.731202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:24.731948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:24.732433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:24.919027 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:24.927525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-94c85bf9-f5d0-4099-a32d-da09e53e04b7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.216171 Oct 23 00:12:24.928098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 336/651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:24 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:24.973009 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:24.973759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:24.981679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:24.982203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:24.982642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:24.983345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:24.983796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:24.984250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:25.123800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:25.132048 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:25.133525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:25.134682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1f7031c0-9c86-45b4-89c3-959ad76fea6e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.166417 Oct 23 00:12:25.135246 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 316/652] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:24 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:25.950793 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:25.951410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:25.957771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:25.958259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:25.958706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:25.959397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:25.959856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:25.960284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:26.096451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:26.105369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-39481126-e4be-4e17-973b-22818ce8f90b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.158389 Oct 23 00:12:26.118855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 337/653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:25 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:26.159895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:26.160602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:26.167578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:26.168123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:26.168614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:26.169309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:26.169753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:26.170207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:26.312099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:26.320836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:26.322243 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:26.323766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-798eda5f-f73d-4951-b013-d693e8dbba4e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1743 microversion: 2.20 time: 0.168260 Oct 23 00:12:26.324612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 317/654] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:26 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:27.131715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:27.132352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:27.139057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:27.139459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:27.139898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:27.140616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:27.141080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:27.141558 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:27.281716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:27.291748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cadd82a4-c497-497c-bc3b-0ea556713deb tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1260 microversion: 2.1 time: 0.163804 Oct 23 00:12:27.293388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 338/655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:27 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:27.349606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:27.350218 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:27.356625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:27.357109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:27.357547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:27.358233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:27.358692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:27.359125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:27.493017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:27.501294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:27.502727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:27.503876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-37bade32-e13a-4b18-b3c3-a6f9b1c68c71 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.158417 Oct 23 00:12:27.504432 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 318/656] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:27 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:28.316444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:28.317088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:28.323434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.323910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.324342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.325061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.325509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.325927 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.467704 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:28.476934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e4d5db99-c05d-433c-8011-44023d1332aa tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1444 microversion: 2.1 time: 0.165091 Oct 23 00:12:28.477445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 339/657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:28 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:28.499499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:28.500237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:28.507126 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.507608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.508045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.508763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.509391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.509823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.532018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:28.533117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:28.541494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.541997 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.542437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.543142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:28.543608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:28.544037 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:28.708071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:28.716336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-af503f5d-cfb4-42b2-9fc8-50b59a81d8b1 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1444 microversion: 2.1 time: 0.220481 Oct 23 00:12:28.717333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 319/658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:28 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:28.741988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:28.754239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:28.756056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:28.757647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b75afb00-6f8d-42f1-9195-700ba968bb5b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.231406 Oct 23 00:12:28.760554 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 340/659] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:28 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:29.785577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:29.786210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:29.792620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:29.793121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:29.793539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:29.794229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:29.794682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:29.795106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:29.930242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:29.939069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:29.940736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:29.941898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5cc99956-0bcf-48fc-a170-da048eb3aad5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.161132 Oct 23 00:12:29.942461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 320/660] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:29 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:30.738635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:30.748853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:30.749743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:30.749743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:30.761469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] Creating event network-changed:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:12:30.767480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-149349b1-088b-49ba-aadc-6ef672bdb4c9 req-f5b942af-1ca8-46d4-b2a6-2767b0966e06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031422 Oct 23 00:12:30.767852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 341/661] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:30.966757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:30.967340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:30.973924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:30.974762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:30.975204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:30.975895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:30.976347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:30.976802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:31.112928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:31.121366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:31.122956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:31.124190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-991f80aa-6426-444e-b3d6-37a2b7e7eca3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.161602 Oct 23 00:12:31.125076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 321/662] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:30 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:32.066262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1558939410", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "networks": [{"uuid": "14b8a3cd-59bd-42ce-aece-f552f98dac26"}]}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:32.127903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] validate_networks() for [('14b8a3cd-59bd-42ce-aece-f552f98dac26', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:12:32.152631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:32.153874 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:32.165372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:32.166238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:32.166915 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:32.167819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:32.168570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:32.169215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:32.605008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:32.619906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:32.623357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:32.625316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-05373e46-cb00-4baa-8c93-305c0b5326bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.477520 Oct 23 00:12:32.627482 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 322/663] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:32 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:32.812271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:12:32.816759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:12:32.816759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:12:32.816759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:12:32.816759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:12:32.825029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:32.825962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:32.826691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:32.827779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:32.828403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:32.829627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:32.850110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Getting quotas for project a199c36a2f054a03ae399ace011c3c95. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:12:32.855419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Getting quotas for user 0675f7444e544220b53a34dd3086edc5 and project a199c36a2f054a03ae399ace011c3c95. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:12:32.869410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:12:32.872056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:12:32.921106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-24bc6e9f-2e2f-4756-b923-b3180e2218a9 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859669 Oct 23 00:12:32.931009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 342/664] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:12:32.936379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fce58207-018a-45b7-a2f5-4fed7a24c66a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:32.937117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fce58207-018a-45b7-a2f5-4fed7a24c66a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:33.023084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fce58207-018a-45b7-a2f5-4fed7a24c66a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:33.031465 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fce58207-018a-45b7-a2f5-4fed7a24c66a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1219 microversion: 2.1 time: 0.099004 Oct 23 00:12:33.032289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 323/665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:32 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:33.658958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:33.660633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:33.670100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:33.671039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:33.671824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:33.673446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:33.674252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:33.674999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:33.830578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:33.839556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:33.841561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:33.842876 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1745bc75-812e-425d-bef5-022948aa210e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.190321 Oct 23 00:12:33.843606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 343/666] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:33 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:34.054440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:34.055700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:34.062619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:34.063152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:34.063732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:34.064434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:34.064921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:34.065581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:34.133134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:34.136957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:34.143328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6cb22d7d-4ff8-496a-9576-00e419882a61 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1271 microversion: 2.1 time: 0.092577 Oct 23 00:12:34.144206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 324/667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:34 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:34.874240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:34.875560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:34.882629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:34.883335 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:34.883936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:34.884825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:34.885508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:34.886210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:35.049066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:35.057918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:35.060879 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:35.062280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7a05e167-cdfb-4f22-b6f4-fcb7dd89f968 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.194982 Oct 23 00:12:35.063378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 344/668] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:34 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:35.170724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:35.171908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:35.179831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:35.180324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:35.180777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:35.181830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:35.182387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:35.182814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:35.375512 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:35.385884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-71f99ccd-9271-4654-b0c8-9044838a1700 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.219573 Oct 23 00:12:35.405556 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 325/669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:35 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:35.924435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590f1017-7e91-4388-83bd-ab8992271c36", "tag": "5aba1014-b4ab-4809-b4e1-9ccc567702ca"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:35.941164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:35.941648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:35.942079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:35.953347 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] Creating event network-changed:5aba1014-b4ab-4809-b4e1-9ccc567702ca for instance 590f1017-7e91-4388-83bd-ab8992271c36 on hv-cinder-86156 Oct 23 00:12:35.959912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-1aa9270c-faae-4551-a1e8-a8b0f710b4c7 req-00940cc6-c5f3-4bf9-838d-ed067090fe7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039591 Oct 23 00:12:35.960553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 345/670] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:36.089963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:36.091449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:36.119583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:36.121933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:36.128780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:36.129831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:36.130518 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:36.131452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:36.309210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:36.320901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:36.322376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:36.323775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-44ad3ebf-6b57-4af2-b97b-c75429e0699c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.238303 Oct 23 00:12:36.324342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 326/671] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:36 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:36.411654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:36.412639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:36.419530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:36.420376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:36.421077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:36.422011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:36.422733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:36.423459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:36.585760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:36.596368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-55f79abf-1e6a-4af5-8491-7e6ce5e97f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.188833 Oct 23 00:12:36.596983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 346/672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:36 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:37.351231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:37.351828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:37.358860 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:37.359355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:37.359792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:37.361501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:37.361979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:37.362412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:37.512135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:37.522467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:37.523928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:37.525195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a02c27f8-e043-4cdd-8c97-88ad2faf2e74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.178196 Oct 23 00:12:37.526061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 327/673] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:37 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:37.619505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:37.620114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:37.628274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:37.628787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:37.629225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:37.629928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:37.630383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:37.630913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:37.787563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:37.797655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-88a23e82-ad0f-45ad-82b6-51c168c59158 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.181769 Oct 23 00:12:37.798500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 347/674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:37 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:38.551413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:38.551950 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:38.558831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:38.559328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:38.559771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:38.560481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:38.560960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:38.561389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:38.711775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:38.720940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:38.722721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:38.724124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8b25144e-c1ce-443a-8dea-a04e3178a49e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.176675 Oct 23 00:12:38.725709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 328/675] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:38 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:38.821844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:38.822609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:38.830435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:38.830930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:38.831372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:38.832079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:38.832628 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:38.833182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:38.975577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:38.984061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a8d97f78-ac0c-4759-b2db-0a53a7f0aec4 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.166339 Oct 23 00:12:38.984943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 348/676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:38 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:39.751012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:39.751629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:39.758840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:39.759406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:39.759913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:39.760841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:39.761508 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:39.762351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:39.931911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:39.941500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:39.942754 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:39.944221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5bc5dcc3-3324-453d-8d08-f7e2a8f664f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.197322 Oct 23 00:12:39.944519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 329/677] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:39 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:40.006741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:40.008040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:40.015827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:40.016477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:40.017036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:40.017894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:40.018444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:40.019095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:40.178364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:40.182559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:40.187461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1918aa08-ef1a-4e0d-927c-cd3b953e48dd tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.184827 Oct 23 00:12:40.201022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 349/678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:40 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:40.970536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:40.971159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:40.978910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:40.979403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:40.979841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:40.980667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:40.981130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:40.981587 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:41.140101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:41.148964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:41.150407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:41.151549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8a5173e6-6d63-4616-b50b-a13a8b56372d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.185835 Oct 23 00:12:41.152138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 330/679] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:40 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:41.210975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:41.211593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:41.218384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:41.218867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:41.219324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:41.220605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:41.221064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:41.221488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:41.352995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:41.360855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2de7ae65-8218-4f5e-b2e5-5eedf256b1c7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.153614 Oct 23 00:12:41.361429 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 350/680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:41 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:42.178752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:42.179306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:42.186176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:42.186652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:42.187085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:42.187924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:42.189564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:42.190019 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:42.326610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:42.334869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:42.336289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:42.337462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9b7b59c7-6b02-4688-8518-3fe3db5192f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1738 microversion: 2.20 time: 0.162751 Oct 23 00:12:42.338018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 331/681] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:42 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:42.383100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:42.383733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:42.390443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:42.390927 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:42.391534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:42.392335 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:42.392830 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:42.393258 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:42.523346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:42.531395 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-14e74ab2-6808-4d46-9d67-f338e489b69c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.152007 Oct 23 00:12:42.532669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 351/682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:42 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:43.103009 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590f1017-7e91-4388-83bd-ab8992271c36", "name": "network-vif-plugged", "status": "completed", "tag": "5aba1014-b4ab-4809-b4e1-9ccc567702ca"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:43.112240 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:43.115749 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:43.116293 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:43.116981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:43.133964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] Creating event network-vif-plugged:5aba1014-b4ab-4809-b4e1-9ccc567702ca for instance 590f1017-7e91-4388-83bd-ab8992271c36 on hv-cinder-86156 Oct 23 00:12:43.142586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-e262fdde-1097-426c-bee6-21a374d7bd98 req-638e6fb5-cbf4-42c4-b227-5c10cce5bc48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043123 Oct 23 00:12:43.143734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 332/683] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:43.365725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:43.366366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:43.368189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:43.369427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:43.375635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:43.376133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:43.376637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:43.378022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:43.378520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:43.379304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:43.517592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:43.525620 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:43.527065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:43.528212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6c434dbf-6b05-4be8-a54b-d0b42b5be5a6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1720 microversion: 2.20 time: 0.166404 Oct 23 00:12:43.528803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 352/684] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:43 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:43.559992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:43.560757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:43.568013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:43.568468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:43.568932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:43.569619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:43.570076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:43.570504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:43.704436 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:43.712882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ed336575-a556-4bc3-8a5b-a831afd40963 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.157023 Oct 23 00:12:43.713448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 333/685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:43 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:44.553716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:44.554326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:44.560758 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:44.561242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:44.561679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:44.562368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:44.562823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:44.563774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:44.709859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:44.718134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:44.719702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:44.721339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2b0b7d8d-1341-4ae1-a8e4-9435ddd57087 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1720 microversion: 2.20 time: 0.171561 Oct 23 00:12:44.721897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 353/686] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:44 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:44.735148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:44.735841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:44.742282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:44.742762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:44.743191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:44.743889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:44.744343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:44.744797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:44.879235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:44.886884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b688cca3-c70e-4e40-af7a-abfa40368f89 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.155618 Oct 23 00:12:44.887447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 334/687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:44 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:45.752729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:45.753330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:45.755589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:45.760783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.761265 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.761696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:45.762380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.762829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.763250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:45.895841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:45.904295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:45.905791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:45.906957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1a807e2d-1a48-44ea-8447-fa1b50ae87ab tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1723 microversion: 2.20 time: 0.158365 Oct 23 00:12:45.907514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 354/688] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:45 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:45.910195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:45.910810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:45.917975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.918490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.919497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:45.919984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.921819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.922841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:45.940181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da2b7424-ea2f-452b-9826-f0b109011d59"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:45.942603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:45.948563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.949050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.949488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:45.950182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:45.950685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:45.951116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:46.063164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:46.071475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c20b31fc-1be0-439a-9b55-8c8a7606a20a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.166172 Oct 23 00:12:46.072131 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 335/689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:45 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:46.230624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8a882789-0e08-42bc-becf-b8a0cf21e73f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295076 Oct 23 00:12:46.231234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 355/690] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 23 00:12:45 2022] POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:12:46.362641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:46.363226 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:46.369689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:46.370172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:46.370609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:46.371294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:46.371840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:46.372321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:46.417329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118854) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 00:12:46.483979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0ad28d32-28f7-409c-9809-c55da383c0d4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/action" status: 202 len: 0 microversion: 2.20 time: 0.126034 Oct 23 00:12:46.484603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 336/691] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 00:12:46 2022] POST /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:12:46.493483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:46.494091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:46.500619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:46.501105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:46.501542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:46.503219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:46.503676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:46.504102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:46.647046 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:46.658419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:46.660128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:46.661369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dfb692cd-c0e8-4da4-858d-11df27adfe1c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1749 microversion: 2.20 time: 0.171721 Oct 23 00:12:46.662057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 356/692] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:46 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:47.097853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:47.099108 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:47.107536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:47.108297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:47.108921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:47.109719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:47.110180 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:47.110624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:47.230159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "name": "network-vif-unplugged", "status": "completed", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:47.241008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:47.244503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:47.245165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:47.258889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.compute.server_external_events [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] Unable to find a host for instance 71d26bbe-0243-4653-9465-2afd08fcce15. Dropping event network-vif-unplugged {{(pid=118855) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 00:12:47.259918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-03d4d16d-5149-4909-a9f7-2beff2dd6b8e req-a72d6e8d-64a4-4eb5-a624-71158c843d01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033757 Oct 23 00:12:47.260546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 357/693] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 00:12:47.281101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:47.290526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49de9854-8e79-4f75-9034-b8f082f366fa tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1319 microversion: 2.1 time: 0.198391 Oct 23 00:12:47.301851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 337/694] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:47 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:12:47.687234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:47.687760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:47.694206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:47.694698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:47.695115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:47.695797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:47.696246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:47.696709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:47.833488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:47.841894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:47.843318 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:47.844447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-39c782a5-fc57-4bde-adc1-7eb0f3c4aac5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1751 microversion: 2.20 time: 0.161123 Oct 23 00:12:47.845051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 358/695] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:47 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:48.313467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:48.314195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:48.316857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:48.321985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.322454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.322887 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.323580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.324064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.324499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.457859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:48.465526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-81da98fc-33dd-456a-8be0-2eafa0d9aaf0 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1508 microversion: 2.1 time: 0.155955 Oct 23 00:12:48.466085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 338/696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:12:48 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:12:48.489390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a8110a-f948-4c9e-8d80-a7db81e944d6", "device": "/dev/sdb"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:12:48.491916 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:48.498664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.499148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.499598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.500288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.500771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.501200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.871177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:48.871791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:48.878921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.879449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.879881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.880604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:48.881157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:48.881590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:48.992234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-280de282-a69a-4601-a1c4-37dfbb8b26ef tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "POST /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507047 Oct 23 00:12:48.993263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 359/697] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:12:48 2022] POST /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:12:49.028165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:49.040068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:49.042145 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:49.043537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ede08df7-d045-4f92-a2fa-cfc0cac6869a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.176377 Oct 23 00:12:49.044570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 339/698] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:48 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:12:50.076284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:50.083664 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:50.096404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:50.103496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:50.106359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:50.107296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:50.109697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:50.110841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:50.311029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:50.320640 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:50.322073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:50.323233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e263075f-63ce-4b17-b730-80b312a7bb3e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.253015 Oct 23 00:12:50.323788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 360/699] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:50 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:51.348375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:51.349132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:51.356000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:51.356477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:51.356935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:51.357648 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:51.358098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:51.358516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:51.495025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:51.504382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:51.505837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:51.506998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f06ed566-b7ae-41af-96dd-887df412de6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.162594 Oct 23 00:12:51.507562 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 340/700] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:51 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:52.532508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:52.533147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:52.539508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:52.539986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:52.540422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:52.541126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:52.541575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:52.541995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:52.732233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:52.741764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:52.743208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:52.744377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b2ea65ad-5502-4ee4-80cf-6e4dd41014ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.215916 Oct 23 00:12:52.744983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 361/701] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:52 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:53.769919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:53.770452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:53.777138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:53.777622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:53.778058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:53.778745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:53.779198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:53.779620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:53.783791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:53.973925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:53.982928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:53.984374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:53.985609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a76eb443-cafe-4b2a-bc67-653b56c0d5fe tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.220388 Oct 23 00:12:53.986773 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 341/702] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:53 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:55.013024 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:55.013706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:55.020087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:55.020601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:55.021039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:55.021740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:55.022193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:55.022615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:55.158449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:55.166946 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:55.168374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:55.169549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-88bda30a-7a9e-479f-808d-18e19d2787af tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.160455 Oct 23 00:12:55.170105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 362/703] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:55 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:56.195668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:56.196332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:56.202813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:56.203287 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:56.203746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:56.204551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:56.205640 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:56.206148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:56.343513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:56.354357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:56.355946 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:56.357152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-04bc8628-5c10-49a5-b0ac-5043d2e44404 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.165476 Oct 23 00:12:56.357712 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 342/704] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:56 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:57.385472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:57.386816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:57.394574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:57.395110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:57.395560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:57.396249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:57.396730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:57.397151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:57.401339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:57.537715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:57.546725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:57.548158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:57.549528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-989d9d3e-8f11-49f6-bf5c-a8106f76816f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.169720 Oct 23 00:12:57.550290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 363/705] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:57 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:58.578157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:58.578712 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:58.586511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:58.587193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:58.587664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:58.588530 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:58.588997 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:58.589424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:58.730600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:58.740094 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:58.741641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:58.742805 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ebc4aa0a-83fc-41ed-be28-261bd2380ed9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.168931 Oct 23 00:12:58.743374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 343/706] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:58 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:12:59.767605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:12:59.768834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:12:59.775366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:59.775851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:59.776280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:59.776987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:12:59.777437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:12:59.777856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:12:59.917365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:59.926955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:59.928368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:12:59.929593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b8f9acc8-4e6b-485e-bcdb-92c2feffb6bc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.165866 Oct 23 00:12:59.930139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 364/707] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:12:59 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:00.955890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:00.956527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:00.963010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:00.963491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:00.963927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:00.964643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:00.965099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:00.965524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:01.097948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:01.106933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:01.108370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:01.109560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4c77f024-5101-497b-9ea5-3e2f73c58903 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.157784 Oct 23 00:13:01.110117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 344/708] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:00 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:02.240470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:02.241096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:02.246872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:02.247344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:02.247771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:02.248445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:02.248923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:02.249349 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:02.382788 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:02.391427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:02.392932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:02.394118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ae38dfdb-49e6-4685-9f21-1c97db5d5c1a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.262007 Oct 23 00:13:02.394673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 365/709] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:02 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:03.420340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:03.420993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:03.427451 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:03.427931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:03.428365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:03.429081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:03.429535 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:03.429960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:03.577763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:03.586913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:03.588332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:03.589527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2187e412-75ba-44ca-96d3-ecd46c534b10 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.173095 Oct 23 00:13:03.590083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 345/710] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:03 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:04.615475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:04.616108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:04.618865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:13:04.619016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 (ip 10.222.0.13) !!! Oct 23 00:13:04.625657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:04.626135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:04.626565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:04.627260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:04.628206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:04.628668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:04.769210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:04.779895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:04.781363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:04.782525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-90aaa46f-4237-4d7c-bd91-6c130a49ccc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.171265 Oct 23 00:13:04.783086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 366/711] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:04 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:05.808153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:05.808788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:05.815262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:05.815799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:05.816237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:05.816965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:05.817419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:05.817843 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:05.948611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:05.958080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:05.959524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:05.960730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1f431fa7-08b8-453b-a0ed-20c52cad4939 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.156441 Oct 23 00:13:05.961298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 346/712] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:05 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:06.986487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:06.987659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:06.994048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:06.994580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:06.995017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:06.995746 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:06.996197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:06.996652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:07.133884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:07.145289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:07.146857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:07.147894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f900ae4a-3ed1-4192-8962-05dadb057202 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.165378 Oct 23 00:13:07.148456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 367/713] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:06 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:08.178173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:08.178777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:08.185259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:08.185740 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:08.186169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:08.186857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:08.187308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:08.187728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:08.323309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:08.332558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:08.334008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:08.335169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-eb0e3fe7-7a3f-49f2-821f-7c959035ba74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.161058 Oct 23 00:13:08.335735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 347/714] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:08 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:09.363570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:09.364144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:09.371171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:09.371657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:09.372092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:09.372809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:09.373266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:09.373691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:09.506087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:09.514616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:09.516093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:09.517290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7b97ffb1-9dbd-4aa8-902e-1e0c903a4d34 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.158356 Oct 23 00:13:09.517850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 368/715] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:09 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:10.544759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:10.545306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:10.551857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:10.552327 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:10.552796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:10.553475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:10.553923 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:10.554341 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:10.682275 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:10.690922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:10.692966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:10.694231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b786e5a8-3390-4219-9a75-0071e3bd67c8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153418 Oct 23 00:13:10.694787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 348/716] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:10 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:11.720180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:11.720771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:11.727904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:11.728394 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:11.728854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:11.729548 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:11.730002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:11.730433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:11.861263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:11.870253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:11.871697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:11.872873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-237a8df2-71e6-4a23-a05f-b6129c62c879 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.156681 Oct 23 00:13:11.873424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 369/717] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:11 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:12.898613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:12.899224 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:12.905661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:12.906144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:12.906580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:12.907270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:12.907728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:12.908156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:13.036470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:13.044992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:13.046414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:13.047552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6795db7e-bea9-40ee-b4b5-e214166734cd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.152846 Oct 23 00:13:13.048113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 349/718] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:12 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:14.073186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:14.073787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:14.080133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:14.080636 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:14.081067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:14.081744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:14.082190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:14.083635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:14.212118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:14.220610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:14.222080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:14.223956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e808e9c1-5767-4935-9c35-548672c1f9de tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153901 Oct 23 00:13:14.224613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 370/719] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:14 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:15.249384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:15.249986 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:15.257585 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:15.257836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:15.258274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:15.258951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:15.259401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:15.259821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:15.392099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:15.401390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:15.402814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:15.403957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a7828b4f-16b7-41d8-825d-160d9518f8a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.158445 Oct 23 00:13:15.404530 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 350/720] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:15 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:16.429239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:16.429810 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:16.432063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=34 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:16.437550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:16.438036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:16.438473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:16.439161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:16.439616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:16.440045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:16.568143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:16.576649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:16.578074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:16.579214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3c58b316-ea5d-4377-895d-9f58590547f8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.154673 Oct 23 00:13:16.579768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 371/721] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:16 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:17.605555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:17.606158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:17.612004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:17.612481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:17.612939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:17.613625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:17.614722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:17.615144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:17.749407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:17.761524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:17.764802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:17.766643 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6e6a9194-9d63-456b-9aeb-7140c4e743b8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.165004 Oct 23 00:13:17.767742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 351/722] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:17 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:18.794919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:18.797077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:18.803805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:18.804301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:18.804764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:18.805690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:18.806309 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:18.806735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:18.947476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:18.957208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:18.959338 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:18.960817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2285dcc2-f812-41f0-8404-ada14b2582d2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.169604 Oct 23 00:13:18.961382 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 372/723] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:18 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:19.986582 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:19.987210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:19.989568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=28 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:19.994745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:19.995229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:19.995666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:19.996379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:19.997022 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:19.997450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:20.126806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:20.135557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:20.137107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:20.138362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e6de913d-922e-418e-897c-97d5730c4fe3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.155779 Oct 23 00:13:20.138954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 352/724] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:19 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:21.165099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:21.165710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:21.172076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:21.172598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:21.173038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:21.173720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:21.174171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:21.174593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:21.307259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:21.315820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:21.317296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:21.318445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-be5ef295-0697-43d9-8c4c-5d5b7dfc1788 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.157938 Oct 23 00:13:21.319006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 373/725] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:21 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:22.343406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:22.344038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:22.351864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:22.352284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:22.352745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:22.353459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:22.353912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:22.354333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:22.481650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:22.490419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:22.491841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:22.493035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-932cc237-9bcf-4e6d-b37f-ba53248739b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153461 Oct 23 00:13:22.493591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 353/726] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:22 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:23.518303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:23.518840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:23.525358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:23.525838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:23.526271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:23.526953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:23.527402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:23.527822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:23.656612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:23.665623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:23.667055 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:23.668206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-180ba5ce-41ee-4831-a1c4-f4fb0731641a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153840 Oct 23 00:13:23.668797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 374/727] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:23 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:24.694670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:24.695385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:24.701771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:24.702242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:24.702669 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:24.703345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:24.703796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:24.704214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:24.706784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=77 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:24.834295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:24.842967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:24.844387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:24.845571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-03dd0e5a-5214-401d-8c1a-8153eb0680d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.155500 Oct 23 00:13:24.846134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 354/728] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:24 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:25.871513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:25.872163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:25.878545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:25.879034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:25.879473 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:25.880163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:25.880655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:25.881085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:26.011765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:26.020316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:26.021840 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:26.023002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-94762a7c-3f58-4f0a-a297-cf266a52f846 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.155650 Oct 23 00:13:26.023567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 375/729] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:25 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:27.048911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:27.049424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:27.056058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:27.056563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:27.057008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:27.057695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:27.058148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:27.058571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:27.187026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:27.196254 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:27.197733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:27.198881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8ceacf29-5d04-405f-980f-9b84f62b7a0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153940 Oct 23 00:13:27.199679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 355/730] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:27 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:28.224611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:28.225835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:28.232451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:28.232961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:28.233394 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:28.234080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:28.234530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:28.234950 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:28.237487 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=77 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:28.366908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:28.375764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:28.377431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:28.378678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-83e34d20-219a-4c8e-8c54-89f8bed4b22f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.157972 Oct 23 00:13:28.379248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 376/731] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:28 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:29.404322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:29.404956 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:29.411558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:29.412043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:29.413023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:29.413714 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:29.414172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:29.414593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:29.546968 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:29.556402 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:29.557876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:29.559076 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-67cb2a5c-6f7a-4e3a-93a6-88fbe0139f6a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.158640 Oct 23 00:13:29.559636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 356/732] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:29 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:30.584819 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:30.585342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:30.591591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:30.592070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:30.592528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:30.593211 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:30.593662 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:30.594082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:30.722204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:30.731989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:30.733446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:30.734588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5072cc8f-1623-4856-a96d-f044c0d78b75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.153947 Oct 23 00:13:30.735134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 377/733] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:30 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:31.761843 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:31.762473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:31.768784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:31.769272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:31.769753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:31.770458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:31.770903 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:31.771322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:31.905347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:31.913990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:31.915425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:31.916627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-258f9c6f-d2ed-4ed7-b958-07f7311c0c9b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.158677 Oct 23 00:13:31.917191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 357/734] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:31 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:32.942879 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:32.943500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:32.950274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:32.950781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:32.951279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:32.951995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:32.952456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:32.952936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:33.088774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:33.097783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:33.099230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:33.100422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1fee5393-7f4b-4320-9006-76eb7c515a90 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.161822 Oct 23 00:13:33.101532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 378/735] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:32 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:33.818459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "name": "network-vif-plugged", "status": "completed", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:13:33.828900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:33.829458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:33.829970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:33.841463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] Creating event network-vif-plugged:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:13:33.846449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-f5839445-bb31-4035-8356-2fb289927d07 req-5f88fa88-5c72-48f0-8876-529daeeacb60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Oct 23 00:13:33.847113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 358/736] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:13:34.126512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:34.127120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:34.133615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:34.134090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:34.134519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:34.135194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:34.135643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:34.136061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:34.262183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:34.270596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:34.272014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:34.273848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cb277a56-68f5-455f-b6b4-adea10308b0d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.151527 Oct 23 00:13:34.274396 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 379/737] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:34 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:35.300756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:35.301480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:35.309081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:35.309560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:35.310062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:35.310746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:35.311344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:35.311774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:35.443321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:35.451883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:35.453335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:35.454478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-361c8a53-5f4a-4104-a1d5-6cc1573c7292 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.158882 Oct 23 00:13:35.455028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 359/738] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:35 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:35.900711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:35.901198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:35.907483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:35.907960 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:35.908391 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:35.909096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:35.909546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:35.909961 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:35.991673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lazy-loading 'services' on Instance uuid 590f1017-7e91-4388-83bd-ab8992271c36 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:13:36.061363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f9377cfc-9651-4df9-9b13-363942596c16 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "DELETE /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36/os-volume_attachments/a9a8110a-f948-4c9e-8d80-a7db81e944d6" status: 202 len: 0 microversion: 2.1 time: 0.165326 Oct 23 00:13:36.061944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 380/739] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:13:35 2022] DELETE /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36/os-volume_attachments/a9a8110a-f948-4c9e-8d80-a7db81e944d6 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:13:36.479858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:36.480461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:36.486840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:36.487257 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:36.487687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:36.488365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:36.488844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:36.489264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:36.618987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:36.627418 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:36.628882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:36.630045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-eb5013f4-6c83-4b3f-ae4d-20d1f25d3559 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1807 microversion: 2.20 time: 0.154819 Oct 23 00:13:36.630598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 360/740] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:36 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:37.658289 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:37.658896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:37.665144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:37.665629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:37.666064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:37.666753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:37.667205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:37.667628 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:37.806776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:37.815271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:37.816727 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:37.817872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a44d95cc-106f-4a06-b681-4da9ec3d6e12 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1794 microversion: 2.20 time: 0.164436 Oct 23 00:13:37.818806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 381/741] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:13:37 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1794 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:13:38.248256 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:38.248793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:38.255174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:38.255663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:38.256102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:38.256817 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:38.258068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:38.258280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:38.283559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:13:38.360764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c76e7718-3309-47b5-8da7-63ed677bdcb7 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "DELETE /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 204 len: 0 microversion: 2.1 time: 0.116035 Oct 23 00:13:38.361575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 361/742] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:13:38 2022] DELETE /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:13:38.372086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:38.372744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:38.378624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:38.379102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:38.379539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:38.380223 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:38.380715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:38.381141 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:38.514463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:38.522792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-930767f2-1fcd-4751-bfe4-757daec4375a tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1514 microversion: 2.1 time: 0.154923 Oct 23 00:13:38.523361 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 382/743] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:13:38 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:13:39.548385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:39.549024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:39.557045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:39.557552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:39.558072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:39.558798 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:39.559481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:39.559918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:39.692469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:39.701041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-31094f08-61d0-4cee-8bf7-7def95e3680c tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1514 microversion: 2.1 time: 0.156967 Oct 23 00:13:39.701601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 362/744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:13:39 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:13:40.726413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:40.727351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:40.736369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:40.736885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:40.737320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:40.738013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:40.738465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:40.738885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:40.805302 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0675f7444e544220b53a34dd3086edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a199c36a2f054a03ae399ace011c3c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:13:40.814026 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2e52e2ce-1646-4736-ab60-18592aa4b147 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 200 len: 1472 microversion: 2.1 time: 0.091754 Oct 23 00:13:40.814807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 383/745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:13:40 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:13:40.847085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590f1017-7e91-4388-83bd-ab8992271c36", "name": "network-vif-deleted", "tag": "5aba1014-b4ab-4809-b4e1-9ccc567702ca"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:13:40.857440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:40.857916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:40.858364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:40.869373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] Creating event network-vif-deleted:5aba1014-b4ab-4809-b4e1-9ccc567702ca for instance 590f1017-7e91-4388-83bd-ab8992271c36 on hv-cinder-86156 Oct 23 00:13:40.873955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-b790e95b-b40a-4423-9d2c-4844002e78c9 req-5d4f1bae-cd26-4786-bca8-9564f8432d5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112983 Oct 23 00:13:40.874539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 363/746] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:13:41.838096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:41.838682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] [instance: 590f1017-7e91-4388-83bd-ab8992271c36] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:41.845117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:41.845596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:41.846029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:41.846710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:41.847162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:41.847586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:41.861738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] HTTP exception thrown: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Request method failure captured: Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 HTTP/1.1 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZnw6YJSCokGX0PrA_jkWj_81BnsFH3HrbYZrXADPr2oE1fgX-nD_PjbigGZ9eqdcqPFyFV-t7HUl4DQpuGrWvga1rgnJ6tD_G6ZenN4K6SVhtjdfjEBXATevaBWUcNXfK3r66_Ia_z37U0_2h4HICHUZPOTocxDj9ZNzsF13p-Io4 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: a199c36a2f054a03ae399ace011c3c95 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:13:41.863356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a199c36a2f054a03ae399ace011c3c95", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a199c36a2f054a03ae399ace011c3c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: a199c36a2f054a03ae399ace011c3c95 Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-494041477 Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesSnapshotTestJSON-494041477-project Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 0675f7444e544220b53a34dd3086edc5 Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesSnapshotTestJSON-494041477-project Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. Oct 23 00:13:41.865057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '590f1017-7e91-4388-83bd-ab8992271c36'} Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:13:41.865991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. Oct 23 00:13:41.867696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:13:41.869082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] Returning 404 to user: Instance 590f1017-7e91-4388-83bd-ab8992271c36 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:13:41.869082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f818352e-b18f-4248-8b39-0782c27dab58 tempest-VolumesSnapshotTestJSON-494041477 tempest-VolumesSnapshotTestJSON-494041477-project] 10.222.0.13 "GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36" status: 404 len: 111 microversion: 2.1 time: 0.031159 Oct 23 00:13:41.869082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 384/747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:13:41 2022] GET /compute/v2.1/servers/590f1017-7e91-4388-83bd-ab8992271c36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:13:50.993370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:50.994032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:50.998377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:13:50.998944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:51.006520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:51.008173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:51.008648 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:51.009333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:51.009785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:51.010205 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:51.034437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-058ce746-3d13-4572-8b4f-8cac1832aa48 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/ips" status: 200 len: 146 microversion: 2.1 time: 0.043670 Oct 23 00:13:51.034998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 364/748] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:13:50 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:13:54.457351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69b4e102-3f20-4ff6-83cb-1fc9dd47e2a3"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:13:54.459779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:13:54.463180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=27 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:54.463925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:54.469390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:54.469871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:54.470307 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:54.470995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:13:54.471448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:13:54.471874 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:13:54.718991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-07d47435-7011-4226-89a1-1465de7e7dc2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265385 Oct 23 00:13:54.719588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 385/749] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:13:54 2022] POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:14:06.492830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:06.496229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:14:06.496391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Sun Oct 23 00:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action (ip 10.222.0.13) !!! Oct 23 00:14:06.497834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:06.498652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=4 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:06.508372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:06.508901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:06.509342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:06.569855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Going to try to stop instance {{(pid=118854) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 00:14:06.614501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ae07f0e1-c2c5-4f24-933b-141a5a1ec136 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action" status: 202 len: 0 microversion: 2.1 time: 0.125291 Oct 23 00:14:06.615177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 365/750] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:14:06 2022] POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:14:06.621746 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:06.623197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:06.627769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:06.629220 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:06.637386 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:06.638116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:06.638555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:06.639438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:06.639886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:06.640584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:06.773176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:06.782360 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5ac5d16e-3ff4-4c8c-b184-48f52096c071 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.162191 Oct 23 00:14:06.783120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 386/751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:06 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:07.808312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:07.808957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:07.815005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:07.815491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:07.815936 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:07.816658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:07.817118 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:07.817547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:07.952026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:07.960232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e553af4c-499f-4111-8456-e67db58e5069 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.157312 Oct 23 00:14:07.960835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 366/752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:07 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:08.984091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:08.984766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:08.991088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:08.991558 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:08.991986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:08.992694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:08.993145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:08.993564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:09.125669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:09.134028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fc50573d-3fee-436e-ba43-53ff798a1020 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.153752 Oct 23 00:14:09.134584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 387/753] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:08 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:14:10.157979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:10.158811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:10.166317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:10.167135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:10.167661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:10.168449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:10.169014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:10.169441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:10.318043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:10.328063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e4c9b63d-a15e-49b5-b4c8-78e51abcdde8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.174357 Oct 23 00:14:10.329041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 367/754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:10 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:11.351642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:11.352245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:11.359671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:11.360148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:11.360607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:11.361286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:11.361733 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:11.362200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:11.491956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:11.500449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7af40517-4fa0-4bfe-ae50-9b60783a03ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.152680 Oct 23 00:14:11.501032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 388/755] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:11 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:12.523835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:12.524368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:12.531066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:12.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:12.532006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:12.532728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:12.533185 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:12.533606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:12.659715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:12.668426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4c0a9fc5-d422-48bc-8c2a-bcff1a04f977 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.148523 Oct 23 00:14:12.669023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 368/756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:12 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:13.692995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:13.693638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:13.700869 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:13.701350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:13.701784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:13.702476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:13.702928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:13.703350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:13.836127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:13.844459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-05a0af0c-e5a2-4c14-83cf-b88a52576035 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.155365 Oct 23 00:14:13.845045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 389/757] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:13 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:14.867124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:14.867791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:14.874579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:14.875069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:14.875504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:14.876203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:14.876688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:14.877125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:15.004084 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:15.013092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a4a5e7e7-b037-429b-a767-678605a62456 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.149817 Oct 23 00:14:15.013662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 369/758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:14 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:14:16.035969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:16.036599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:16.043684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:16.044162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:16.044885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:16.045562 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:16.046011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:16.046427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:16.177801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:16.186042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0670aac9-59d5-41ab-a5fe-57a39fdc2e81 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.153882 Oct 23 00:14:16.186602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 390/759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:16 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:17.209816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:17.210424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:17.217010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:17.217486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:17.217920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:17.218595 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:17.219045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:17.219461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:17.349269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:17.358780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1623856f-262c-49fb-af1b-a4f2c35beaac tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.152935 Oct 23 00:14:17.359340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 370/760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:17 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:18.382306 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:18.382903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:18.389937 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:18.390409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:18.390836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:18.391514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:18.391962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:18.392381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:18.519941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:18.528560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b724bf27-2d31-4119-87ec-b215f11abf4f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.150080 Oct 23 00:14:18.529119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 391/761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:18 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:19.552630 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:19.553160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:19.559679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:19.560159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:19.560623 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:19.561310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:19.561765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:19.562191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:19.691694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:19.700358 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-da6c6e1f-cc97-4596-a4d7-da6da9e18e9f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.151699 Oct 23 00:14:19.700965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 371/762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:19 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:20.164822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:20.167646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:20.174129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.174651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.175146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.175968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.176479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.177069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.249752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c5595d7f-935f-47b5-ac63-b4761cce7925 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action" status: 202 len: 0 microversion: 2.1 time: 0.089178 Oct 23 00:14:20.250441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 392/763] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:14:20 2022] POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:14:20.258522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:20.259355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:20.265645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.266130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.266569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.267258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.267737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.268162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.417279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:20.425919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ac2b6eaa-073d-4ee1-bef5-606daebbb104 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1750 microversion: 2.1 time: 0.171255 Oct 23 00:14:20.426722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 372/764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:20 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:20.724843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:20.725551 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:20.731926 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.732415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.732893 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.733584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:20.734042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:20.734468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:20.873510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:20.881642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6763e3b9-e02e-417f-aef3-064b8a35d350 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.161110 Oct 23 00:14:20.882206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 393/765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:20 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:21.450737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:21.451289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:21.457842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:21.458326 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:21.458800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:21.459492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:21.459949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:21.460403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:21.599176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:21.608409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d27b88ea-f326-4395-b94a-7e2549235938 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.162381 Oct 23 00:14:21.608999 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 373/766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:21 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:21.906833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:21.908122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:21.914734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:21.915249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:21.915729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:21.917043 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:21.917493 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:21.917915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:22.048072 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:22.056302 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7ee49544-3ac0-40e4-816a-1534e183aa21 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1724 microversion: 2.1 time: 0.153664 Oct 23 00:14:22.056901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 394/767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:21 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:22.632516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:22.633129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:22.640206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:22.640732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:22.641171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:22.641853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:22.642307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:22.642735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:22.785894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:22.794177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3d7a4f40-6d18-48be-8d27-99b0b8bbbe66 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.165550 Oct 23 00:14:22.794733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 374/768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:22 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:23.079429 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:23.080038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:23.086468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.086951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.087388 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.088195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.088689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.089119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.221752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:23.231179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0598cbe6-f1be-4d85-bcc3-c545158c9b46 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1701 microversion: 2.1 time: 0.155556 Oct 23 00:14:23.231751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 395/769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:23 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:23.254239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:23.260607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.261099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.261534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.323570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Going to try to start instance {{(pid=118855) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 00:14:23.365895 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a8dc77cd-ec3b-46fc-be14-2c5bd2bc06de tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action" status: 202 len: 0 microversion: 2.1 time: 0.115186 Oct 23 00:14:23.366529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 396/770] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:14:23 2022] POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 00:14:23.370993 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5ab869-6341-4563-93b1-e55200302582"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:23.373641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:23.374824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:23.376081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:23.380611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.381082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.381883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.382787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.383240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.383360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.383669 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.383783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.384183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.385584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.385584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.385943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.530962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:23.539885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c91e977f-26a9-4ba2-83e3-8eb15eec6316 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1710 microversion: 2.1 time: 0.168897 Oct 23 00:14:23.541431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 397/771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:23 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1710 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:23.643633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-abab0f01-4c54-4e5f-9a91-4bf92e2470b4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505252 Oct 23 00:14:23.644306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 375/772] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:14:23 2022] POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:14:23.818286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:23.818902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:23.825808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.826298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.826735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.827433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:23.827924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:23.828350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:23.969483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:23.977740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5549d717-0b4f-4d14-aaa3-9aec65ade707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.163638 Oct 23 00:14:23.978801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 398/773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:23 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:24.566471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:24.568132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:24.574674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:24.575213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:24.575659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:24.576312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:24.576967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:24.577400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:24.926252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:24.934984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5f158d18-6be0-4447-a380-f03462eb644a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1710 microversion: 2.1 time: 0.374829 Oct 23 00:14:24.935547 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 376/774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:24 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1710 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:25.001693 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:25.002300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:25.008719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:25.009201 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:25.009637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:25.010322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:25.011687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:25.011981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:25.155033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:25.163162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9e6bdab7-a231-4d7c-bf80-88efe1d5a707 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.165335 Oct 23 00:14:25.163728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 399/775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:24 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:25.958796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:25.959449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:25.966723 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:25.967237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:25.967765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:25.968451 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:25.968981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:25.969439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:26.100678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:26.109617 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-adb41ee0-89da-4a00-b659-3faa0a9f33b8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1714 microversion: 2.1 time: 0.154752 Oct 23 00:14:26.110188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 377/776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:25 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:26.187079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:26.187685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:26.193587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:26.194061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:26.194489 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:26.195162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:26.195611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:26.196030 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:26.214969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:26.338173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:26.346268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5e609c35-7e46-4158-8da1-d19fad31c439 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.163192 Oct 23 00:14:26.346823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 400/777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:26 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:27.369524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:27.370840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:27.377538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:27.378018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:27.378453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:27.379166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:27.379613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:27.380030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:27.520598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:27.529062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cf344592-315f-4a52-8395-d1f201451b19 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.163428 Oct 23 00:14:27.529727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 378/778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:27 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:28.553209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:28.553744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:28.561430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:28.561909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:28.562339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:28.563015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:28.563459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:28.563877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:28.706844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:28.715496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-902fbb70-a6aa-4786-8c10-5060fef72fab tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.166139 Oct 23 00:14:28.716048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 401/779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:28 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:29.738979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:29.739626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:29.746182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:29.746663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:29.747104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:29.747801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:29.748258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:29.748719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:29.752786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:29.890621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:29.898987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-39303d50-806b-4351-b915-3bbd641eae40 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.163870 Oct 23 00:14:29.899688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 379/780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:29 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:30.923964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:30.924580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:30.931150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:30.931631 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:30.932109 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:30.933401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:30.933854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:30.934276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:31.079533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:31.087773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-970d61fb-f918-48c5-9960-22cf1bf74662 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1755 microversion: 2.1 time: 0.167684 Oct 23 00:14:31.088340 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 402/781] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:30 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:31.200199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:31.202591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:31.208988 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:31.209470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:31.209907 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:31.210593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:31.211046 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:31.211474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:31.235952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'flavor' on Instance uuid 9a68187e-f713-4b13-a817-2fb0bfc21ddd {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:14:31.357784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1c7b3fea-0f7d-47d8-8ca8-55f825f862e4 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/action" status: 200 len: 32 microversion: 2.1 time: 0.162125 Oct 23 00:14:31.358388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 380/782] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:14:31 2022] POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:14:31.367746 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:31.368355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:31.374595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:31.375073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:31.375508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:31.376192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:31.376699 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:31.377126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:31.510563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:31.519622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d3e00254-3c83-461c-9221-6583ac33e7c3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.155553 Oct 23 00:14:31.520112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 403/783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:31 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:32.113235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:32.115023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:32.122015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:32.122491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:32.122966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:32.123610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:32.124060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:32.124477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:32.275912 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:32.285017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d1c51fe6-d250-4eca-943a-35688a632a34 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1758 microversion: 2.1 time: 0.175918 Oct 23 00:14:32.285580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 381/784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:32 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:32.543718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:32.544472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:32.551005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:32.551491 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:32.551932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:32.552654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:32.553114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:32.553542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:32.681818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:32.690021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-844be1ba-ca81-4bd9-b763-a81205c59780 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.150857 Oct 23 00:14:32.690585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 404/785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:32 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:33.715124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:33.715726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:33.722127 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:33.722614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:33.723056 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:33.723776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:33.724221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:33.724707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:33.852733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:33.861232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d81c33c0-ea66-4820-93bd-9901b728c14b tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.150692 Oct 23 00:14:33.861800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 382/786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:33 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:34.885139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:34.885767 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:34.892163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:34.892680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:34.893148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:34.893828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:34.894282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:34.894709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:35.024406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:35.032989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7419ce41-fcfe-4e5d-bab4-bca750c71f60 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.151719 Oct 23 00:14:35.033548 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 405/787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:34 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:36.057345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:36.058473 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:36.064650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:36.065128 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:36.065563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:36.066248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:36.066700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:36.067129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:36.192569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:36.200769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f9da61e3-3da7-4778-8287-b5c218975625 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.147263 Oct 23 00:14:36.201334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 383/788] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:36 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:37.224887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:37.225492 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:37.227752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=41 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:37.233455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:37.233931 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:37.234368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:37.235041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:37.235488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:37.235907 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:37.366350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:37.375205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-63394c21-02b2-4ed5-977f-d1dfabea06e9 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.154182 Oct 23 00:14:37.375780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 406/789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:37 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:38.398720 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:38.399236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:38.401796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=39 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:38.406957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:38.407439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:38.407872 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:38.408586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:38.409038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:38.409461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:38.538105 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:38.546259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-36c703cc-4d46-4856-8fc0-7fd1175b6ff2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.151494 Oct 23 00:14:38.546835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 384/790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:38 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:39.570534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:39.571054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:39.578591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:39.579069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:39.579497 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:39.580196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:39.580678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:39.581098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:39.712309 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:39.721175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fde90841-86c6-431f-9a51-d1698d9adcae tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.154556 Oct 23 00:14:39.721739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 407/791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:39 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:40.744809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:40.745609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:40.752260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:40.752782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:40.753223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:40.753909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:40.754390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:40.754811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:40.887854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:40.896262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-48b03a25-626a-4514-a425-6d7268ac5aa0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.155337 Oct 23 00:14:40.896868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 385/792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:40 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:41.920236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:41.920885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:41.927298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:41.927805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:41.928239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:41.928949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:41.929402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:41.929826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:42.058766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:42.066957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bc1d345d-5c7e-4ce7-a357-3a3628eb2530 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.150570 Oct 23 00:14:42.067525 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 408/793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:41 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:43.091255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:43.091858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:43.098328 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:43.098801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:43.099231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:43.099904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:43.100356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:43.100848 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:43.231949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:43.240137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7b0b50c4-5df4-4016-b773-96808ef95726 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.153296 Oct 23 00:14:43.240737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 386/794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:43 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:44.263891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:44.264598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:44.272064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:44.272708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:44.273143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:44.273836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:44.274359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:44.274782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:44.429682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:44.438164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d3412415-5c45-4f7a-a580-6e60d9b897d6 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.178512 Oct 23 00:14:44.438723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 409/795] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:44 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:45.462391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:45.463698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:45.470974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:45.471478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:45.471910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:45.472617 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:45.473063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:45.473481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:45.605904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:45.614038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5d944725-d2db-4f29-9469-2a037bf30c71 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1734 microversion: 2.1 time: 0.155635 Oct 23 00:14:45.614603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 387/796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:45 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:46.637943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:46.638558 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:46.645482 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:46.645966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:46.646401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:46.647088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:46.647541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:46.647965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:46.790023 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:46.799164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3d278625-7d35-472d-85d3-35e7b790343d tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1714 microversion: 2.1 time: 0.165262 Oct 23 00:14:46.799726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 410/797] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:46 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:46.861668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:46.862143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:46.868739 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:46.869227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:46.869660 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:46.870612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:46.871057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:46.871484 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:46.996013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd while it is in vm_state rescued Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Request method failure captured: Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments/3c5ab869-6341-4563-93b1-e55200302582 HTTP/1.1 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXk1DB64OEAO_HayivPa4yPZnDukTjOII3htOFeeqadFEOqR64Ehe_Mm50U0KJvGZFXoIsJj6XeHGetH-BodUiK9ume33fiu7M0ZqUoY2oYVxsyWYjEszyySS1TBVt03CpOhyZpGTaY5bfsPeKf5sZaZV8zqYW2nE1WkUpGicre-0U Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:14:46.997658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08beca89c7f747229a3cc6cb6a363af4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f95f4fc0d5c5428c96545f543139489b Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:14:46.999242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Cannot 'detach_volume' instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd while it is in vm_state rescued Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'server_id': '9a68187e-f713-4b13-a817-2fb0bfc21ddd', 'id': '3c5ab869-6341-4563-93b1-e55200302582'} Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:14:47.001004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd while it is in vm_state rescued Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd while it is in vm_state rescued Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:14:47.002557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Returning 409 to user: Cannot 'detach_volume' instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd while it is in vm_state rescued {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:14:47.003724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-535fc530-1ac6-4444-a386-c8a541956667 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments/3c5ab869-6341-4563-93b1-e55200302582" status: 409 len: 152 microversion: 2.1 time: 0.141445 Oct 23 00:14:47.003724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 388/798] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:14:46 2022] DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments/3c5ab869-6341-4563-93b1-e55200302582 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 00:14:47.007953 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:47.008477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:47.014944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:47.015422 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:47.015853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:47.016560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:47.017011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:47.017429 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:47.082440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6ff2cc96-24ab-4af3-ab5f-d0f89cf277e5 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/action" status: 202 len: 0 microversion: 2.1 time: 0.078119 Oct 23 00:14:47.083119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 411/799] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:14:47 2022] POST /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:14:47.092505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:47.093130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:47.099563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:47.100072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:47.100538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:47.101226 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:47.101684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:47.102133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:47.237047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:47.245779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4017ca1c-72c9-4c8b-bbce-cd03d5a47e29 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1722 microversion: 2.1 time: 0.157634 Oct 23 00:14:47.246336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 389/800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:47 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:48.270707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:48.271414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:48.278051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.278546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.278985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:48.279674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.280131 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.280599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:48.412998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:48.421366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-83292ae3-032f-4fab-9033-89a914f2bc7f tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1722 microversion: 2.1 time: 0.155489 Oct 23 00:14:48.421933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 412/801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:48 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:48.836319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:48.836888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:48.843745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.844229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.844711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:48.845404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.845856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.846285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:48.875311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-842d629f-d846-4460-948d-6066b612777e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments/da2b7424-ea2f-452b-9826-f0b109011d59" status: 200 len: 194 microversion: 2.20 time: 0.043085 Oct 23 00:14:48.875883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 390/802] 10.222.0.13 () {60 vars in 1454 bytes} [Sun Oct 23 00:14:48 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments/da2b7424-ea2f-452b-9826-f0b109011d59 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:14:48.944103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:48.944652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:48.950549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.951031 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.951462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:48.952144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:48.952625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:48.953047 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:49.033575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lazy-loading 'services' on Instance uuid 71d26bbe-0243-4653-9465-2afd08fcce15 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:14:49.108171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-119b1231-3bbd-4a43-a5f0-497ff54895f1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments/da2b7424-ea2f-452b-9826-f0b109011d59" status: 202 len: 0 microversion: 2.20 time: 0.167781 Oct 23 00:14:49.108864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 413/803] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 23 00:14:48 2022] DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments/da2b7424-ea2f-452b-9826-f0b109011d59 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:14:49.117515 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:49.119762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:49.126002 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:49.126485 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:49.126919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:49.127606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:49.128057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:49.128480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:49.158658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3b1c42ec-21cc-4f86-9283-37eb871617ce tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045068 Oct 23 00:14:49.159203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 391/804] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 00:14:49 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:14:49.446066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:49.446692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:49.453878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:49.454358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:49.454790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:49.455477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:49.455930 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:49.456353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:49.587150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:49.595642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-45838df4-36cd-4ee1-8750-9dc603771a79 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1722 microversion: 2.1 time: 0.154747 Oct 23 00:14:49.596210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 414/805] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:49 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:50.171692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:50.174627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:50.181440 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:50.181914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:50.182342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:50.183026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:50.183487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:50.184806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:50.213061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a8cf6d55-c107-428c-a572-37e8a216dc09 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045869 Oct 23 00:14:50.213609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 392/806] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 00:14:50 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:14:50.619466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:50.620328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:50.627302 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:50.627779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:50.628212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:50.628935 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:50.629384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:50.629832 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:50.647574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:50.761938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:50.773914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9238c3e3-ef36-45b0-a94a-9e653091caea tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1722 microversion: 2.1 time: 0.158045 Oct 23 00:14:50.773914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 415/807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:50 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:51.227471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:51.229893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:51.237807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.238284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.238713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:51.239391 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.239837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.240254 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:51.264202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:51.269000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9eba19b0-8c2e-45ea-8d5a-972a25a777c2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046593 Oct 23 00:14:51.269543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 393/808] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 00:14:51 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:14:51.798989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:51.799592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:51.806239 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.806729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.807160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:51.807845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.808297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.809230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:51.936891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:51.945092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-958731c7-86d9-4ce0-aee2-1eb1eabb5a77 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1728 microversion: 2.1 time: 0.149906 Oct 23 00:14:51.945652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 416/809] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:14:51 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:51.968419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:51.968896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:51.975742 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.976238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.976704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:51.977400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:51.977862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:51.978284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.056578 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-55aa75eb-ac89-4435-9d9e-f821f99361ac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091981 Oct 23 00:14:52.057161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 394/810] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:14:51 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:14:52.282137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:52.284325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:52.290581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.291071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.291534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.292225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.292717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.293660 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.323267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8b4891d7-60ca-45c3-a6ef-d9db9fb9c4a7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045586 Oct 23 00:14:52.323825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 417/811] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 00:14:52 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:14:52.387470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:52.388017 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:52.393904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.394385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.394818 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.395503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.395955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.396403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.425189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:14:52.504467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9377ec6f-052b-4b16-b728-cbf927a6b403 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 204 len: 0 microversion: 2.20 time: 0.120990 Oct 23 00:14:52.508461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 395/812] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 00:14:52 2022] DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 00:14:52.514660 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:52.515276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:52.521142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.521626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.522064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.522749 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:52.523206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:52.523666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:52.752735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:52.760787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:52.762400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:52.763572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cdfd5b82-656d-43c4-a68b-cb64b7d54ed4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.253427 Oct 23 00:14:52.764133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 418/813] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:14:52 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:14:53.084503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:53.094457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:53.094931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:53.095361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:53.107008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] Creating event network-changed:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:14:53.112091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-0a4e3dcb-7f65-4724-802d-7586285e19ff req-ceb1b53b-f0a7-4ea5-8e10-e946d460a3ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094773 Oct 23 00:14:53.112893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 396/814] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:14:53.789021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:53.789732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:53.797038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:53.797650 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:53.798154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:53.798919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:53.799444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:53.799873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:53.937281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:53.945400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:53.946910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:53.948154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f8d608d3-6697-42e5-8017-808269f51abd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1722 microversion: 2.20 time: 0.163185 Oct 23 00:14:53.948820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 419/815] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:14:53 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:14:54.975835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:54.976833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:54.983280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:54.983770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:54.984209 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:54.984930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:54.985390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:54.985852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:55.243561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:55.254048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:55.254744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:55.254985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:55.266501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] Creating event network-changed:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:14:55.271551 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-fcdb298d-a5a9-4bfb-a797-d35efe0183a5 req-06d888a9-874d-4ec8-9a76-83e8722278db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Oct 23 00:14:55.272316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 420/816] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:14:55.282791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:55.298610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:55.300317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:55.301497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1c9ba5f1-5f8a-41a0-a93a-79c3f570f7c7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1655 microversion: 2.20 time: 0.330832 Oct 23 00:14:55.316960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 397/817] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:14:54 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1655 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:14:56.330683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:56.331511 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:56.338822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:56.339643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:56.340175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:56.341159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:56.342083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:56.342249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:56.387523 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:56.388016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:56.388467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:56.388951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lazy-loading 'fault' on Instance uuid 71d26bbe-0243-4653-9465-2afd08fcce15 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:14:56.435896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:56.443555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:56.445113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:14:56.446271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a74584dc-003e-48fc-971b-e08d7a226d4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 200 len: 1370 microversion: 2.20 time: 0.122638 Oct 23 00:14:56.447013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 421/818] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:14:56 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:14:57.288075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d26bbe-0243-4653-9465-2afd08fcce15", "name": "network-vif-deleted", "tag": "e33f9048-d354-4819-a218-9b41d4e1c46a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:57.299271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:57.299765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:57.300202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:57.312343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] Creating event network-vif-deleted:e33f9048-d354-4819-a218-9b41d4e1c46a for instance 71d26bbe-0243-4653-9465-2afd08fcce15 on hv-cinder-86156 Oct 23 00:14:57.318069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-a5206a83-2bc6-4370-96b9-8760757e2d42 req-27a2a4b2-876e-47ed-8a01-d3d70fc397f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Oct 23 00:14:57.318947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 398/819] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:14:57.473629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:57.474244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:14:57.481059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:57.481539 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:57.481975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:57.482697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:14:57.483162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:14:57.483582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:14:57.498741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 HTTP/1.1 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:14:57.500420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:14:57.502228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '71d26bbe-0243-4653-9465-2afd08fcce15'} Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:14:57.503228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:14:57.504466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:14:57.505741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:14:57.505741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1124d8d5-3df1-45bd-b448-6eb882207568 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 404 len: 111 microversion: 2.20 time: 0.032103 Oct 23 00:14:57.505741 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 422/820] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:14:57 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:14:57.511577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-00272b53-ec37-4e1a-a446-0adad6b6b2d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '.version_select at 0x7f3f8d727e50>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:14:57.535438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-00272b53-ec37-4e1a-a446-0adad6b6b2d9 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147605134" status: 204 len: 0 microversion: 2.20 time: 0.028075 Oct 23 00:14:57.536007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 399/821] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 23 00:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147605134 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 00:14:58.201232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4d747722-216b-45ab-a7a5-d8b1935f1f75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: .version_select at 0x7f3f91021550>, body: {"keypair": {"name": "tempest-keypair-400624086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXBHrlMi3rDS1NmwS5vUAC9uNymBXuu/90uj15sug7E0uMkMdURBibF10E1tA+GjZuthfd2zeFz1RCHk81EefL5xiFYVFjSOflaohDXBFcBl8RTYhqZtHy37+Dp/OF5gQ=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:58.217662 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4d747722-216b-45ab-a7a5-d8b1935f1f75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for project 55445c398b424025b2588386af037755. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:14:58.221478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-4d747722-216b-45ab-a7a5-d8b1935f1f75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for user 8b4ef165353f4f1189400c005519c2ac and project 55445c398b424025b2588386af037755. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:14:58.247587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4d747722-216b-45ab-a7a5-d8b1935f1f75 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050792 Oct 23 00:14:58.248180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 423/822] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 23 00:14:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 00:14:59.503668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-893888550", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f2fafb2-ad48-465f-83e8-e4588186756a"}], "security_groups": [{"name": "tempest-securitygroup--348676488"}], "key_name": "tempest-keypair-400624086", "user_data": "}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:14:59.611187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] validate_networks() for [('8f2fafb2-ad48-465f-83e8-e4588186756a', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:15:00.069409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:15:00.069829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:15:00.070301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:15:00.070713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:15:00.071112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:15:00.080248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:00.080762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:00.081197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:00.081905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:00.082353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:00.082771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:00.100704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for project 55445c398b424025b2588386af037755. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:15:00.104971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Getting quotas for user 8b4ef165353f4f1189400c005519c2ac and project 55445c398b424025b2588386af037755. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:15:00.117235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:15:00.119565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:15:00.164791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6686527d-253b-4203-9c66-4220301e3e91 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.665992 Oct 23 00:15:00.165433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 400/823] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 23 00:14:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 00:15:00.177743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:00.178375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:00.236589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:00.244951 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:00.246535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:00.247616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e2461c17-3090-458c-8274-a01bf962b57e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1280 microversion: 2.20 time: 0.074331 Oct 23 00:15:00.248152 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 424/824] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:00 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:01.273028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:01.273559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:01.280702 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:01.281186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:01.281619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:01.282300 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:01.282752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:01.283171 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:01.345815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:01.354748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:01.356559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:01.357927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ef9b0979-d812-4bd4-9243-4c908ea94064 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1332 microversion: 2.20 time: 0.089220 Oct 23 00:15:01.358697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 401/825] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:01 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:02.384807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:02.385496 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:02.392053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:02.392416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:02.392878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:02.393583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:02.394038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:02.394462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:02.537001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:02.546270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:02.547648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:02.548806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0267e675-9f7a-444d-97ed-75937a17ec62 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.169342 Oct 23 00:15:02.549358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 425/826] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:02 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:03.007196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:03.017991 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:03.018463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:03.018894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:03.029731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] Creating event network-changed:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:15:03.034668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-8579d5b1-cc44-4862-ab0e-87e664e033a1 req-701880a7-08dc-4295-9137-60bba0ef57a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Oct 23 00:15:03.035329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 402/827] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:03.573034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:03.573691 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:03.581290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:03.581941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:03.582386 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:03.583091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:03.583550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:03.583981 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:03.718608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:03.727068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:03.728605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:03.729965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dbbd4e19-f21e-4ae4-9535-afa456a958f6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.160866 Oct 23 00:15:03.730685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 426/828] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:03 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:04.756301 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:04.756932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:04.763474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:04.763953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:04.764384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:04.765091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:04.765541 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:04.765962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:04.898103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:04.906072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:04.907489 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:04.908601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-996d3c71-a7ed-4957-8a31-98baeb527a74 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.157111 Oct 23 00:15:04.909153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 403/829] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:04 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:05.933595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:05.934979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:05.942781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:05.943273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:05.943714 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:05.944428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:05.944919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:05.945377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:06.123069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:06.131170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:06.132651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:06.133776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7829a1e0-aab1-468b-8627-9161e6b2e2df tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.204717 Oct 23 00:15:06.134655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 427/830] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:05 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:07.159028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:07.159641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:07.166113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:07.166598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:07.167039 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:07.167721 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:07.168745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:07.169177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:07.300100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:07.308152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:07.309805 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:07.310892 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-180f42d1-2350-482a-9c47-9fb822610f59 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.155734 Oct 23 00:15:07.311448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 404/831] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:07 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:08.336411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:08.337158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:08.339624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:08.346086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:08.346572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:08.347011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:08.347711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:08.348163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:08.348624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:08.480594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:08.489871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:08.491619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:08.492752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dbcea6f6-d582-49ec-a2ad-602efa5ff22c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.160261 Oct 23 00:15:08.493305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 428/832] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:08 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:09.517649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:09.518266 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:09.525919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:09.527087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:09.527222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:09.527558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:09.528346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:09.528842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:09.529276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:09.661864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:09.670446 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:09.671893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:09.673033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-da60c2e9-b715-4357-a326-339398811e82 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.159286 Oct 23 00:15:09.673591 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 405/833] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:09 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:10.520495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:10.583224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "name": "network-vif-plugged", "status": "completed", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:10.592783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:10.593330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:10.593774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:10.604898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] Creating event network-vif-plugged:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:15:10.610177 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-235dd337-8267-4c39-96ca-8a6d275a2664 req-40c3c4c2-d5f7-41bf-bd86-7a4bee691b61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094569 Oct 23 00:15:10.610755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 429/834] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:10.701374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:10.701981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:10.704219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:10.704935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:10.711921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:10.712452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:10.712907 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:10.713622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:10.714069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:10.714490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:10.904615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:10.912559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:10.913984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:10.915070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-42cea926-60d1-407d-bd28-fb9d2310a611 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.218810 Oct 23 00:15:10.915663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 406/835] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:10 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:11.941586 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:11.942284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:11.948384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:11.948902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:11.949938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:11.950625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:11.951079 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:11.951507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:12.079033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:12.087101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:12.088569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:12.089672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0a271d90-c996-4405-ba7a-b21cac95107d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1405 microversion: 2.20 time: 0.152830 Oct 23 00:15:12.090763 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 430/836] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:11 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:13.116113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:13.116777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:13.123861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:13.124338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:13.124793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:13.125471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:13.125922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:13.126340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:13.254812 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:13.262769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:13.264189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:13.265350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a41d055f-f7e4-42bd-b493-4739b1b275ee tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1598 microversion: 2.20 time: 0.153203 Oct 23 00:15:13.265903 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 407/837] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:15:13 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:15:13.289476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:13.289965 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:13.296932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:13.297412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:13.297849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:13.298534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:13.298988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:13.299412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:13.380968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3e5362fd-bda3-4383-8041-2c26e69ccee8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095380 Oct 23 00:15:13.381654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 431/838] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 23 00:15:13 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 00:15:14.515600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:14.525313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:14.525870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:14.526370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:14.537193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] Creating event network-changed:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:15:14.542210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-5722d994-7494-4c60-946f-c8bbbda6c3e0 req-45cf65fe-ce3d-430e-aa45-fb9d251778f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030920 Oct 23 00:15:14.542908 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 408/839] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:33.315625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=7 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:33.316508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=74 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:33.420815 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:33.421345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:33.427184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:33.427659 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:33.428090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:33.428802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:33.429252 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:33.429675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:33.508800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lazy-loading 'services' on Instance uuid 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:15:33.580690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bd3203d1-81be-4493-894d-876866479412 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments/69b4e102-3f20-4ff6-83cb-1fc9dd47e2a3" status: 202 len: 0 microversion: 2.1 time: 0.266261 Oct 23 00:15:33.581424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 432/840] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:15:33 2022] DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments/69b4e102-3f20-4ff6-83cb-1fc9dd47e2a3 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:15:34.709150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=7 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:34.709949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:34.714143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:34.722649 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:34.723152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:34.723586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:34.746474 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Going to try to stop instance {{(pid=118854) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 00:15:34.787856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cb62d1d7-a6f9-44be-980f-aa455280e80d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action" status: 202 len: 0 microversion: 2.1 time: 0.080296 Oct 23 00:15:34.788454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 409/841] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:15:34 2022] POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:15:34.798232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:34.799621 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:34.805915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:34.806372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:34.806811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:34.807505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:34.807956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:34.808407 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:34.950524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:34.958887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4e201053-c4bb-4367-82ec-cbab95184366 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.165440 Oct 23 00:15:34.959449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 433/842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:34 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:35.985607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:35.986305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:35.992294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:35.992800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:35.993234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:35.993917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:35.994366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:35.994783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:36.126370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:36.134028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b351064d-cb52-4321-a2eb-b906cfdc11c4 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.154513 Oct 23 00:15:36.134592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 410/843] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:35 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:37.157244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:37.157851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:37.164225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:37.164737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:37.165171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:37.165851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:37.166298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:37.166712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:37.292700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:37.301244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ab89104f-65b1-4c66-843f-55ae101ad22a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.147976 Oct 23 00:15:37.301802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 434/844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:37 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:38.324709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:38.325315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:38.332303 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:38.332879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:38.333312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:38.333990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:38.334438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:38.334858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:38.465708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:38.473464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9f9c9587-94be-4c1e-b2f4-195cc378b5d6 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.152552 Oct 23 00:15:38.474107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 411/845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:38 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:39.497533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:39.498064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:39.504530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:39.505013 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:39.505446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:39.506122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:39.506572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:39.506991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:39.635208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:39.643526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a00a2726-5f3b-4ce8-8c43-10ef00f112b9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.149926 Oct 23 00:15:39.644092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 435/846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:39 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:40.668218 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:40.668858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:40.675837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:40.676345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:40.676819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:40.677507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:40.677964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:40.678389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:40.813361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:40.821041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e213ff16-a086-4aae-94ae-1b5bf57b6b70 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.156703 Oct 23 00:15:40.821609 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 412/847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:40 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:41.312024 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-723572091"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:41.312928 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:41.318480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:41.318958 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:41.319418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:41.320102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:41.320578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:41.321002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:41.445270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.network.security_group_api [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Removing security group e716dc17-d7d7-4e27-8455-88f9c85f94a6 from port 1ee74db1-8e09-4822-921d-2ca859c0ee09 Oct 23 00:15:41.759109 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6d03b8cd-c1fe-4cf8-814f-6aba3cc5db2f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action" status: 202 len: 0 microversion: 2.1 time: 0.545906 Oct 23 00:15:41.760116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 436/848] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:15:41 2022] POST /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:15:41.803126 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:41.816205 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:41.817241 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:41.818265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:41.832196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] Creating event network-changed:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:15:41.837434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-1aa8f772-0cf9-44d3-ba80-9b16a619b809 req-a200f2d0-be9d-4f3c-b1a6-e1b01329600b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037902 Oct 23 00:15:41.839098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 413/849] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:41.848372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:41.848372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:41.851899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:41.852504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:41.853009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:41.853947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:41.854588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:41.855187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:42.090176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:42.101676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-beb4c052-9938-41ed-8d79-ff58c7d9fbd0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.260355 Oct 23 00:15:42.102679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 437/850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:41 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:42.840021 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:42.840743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:42.841083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:42.847347 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:42.847949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:42.848688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:42.849646 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:42.850207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:42.850844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:42.851848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:42.852319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:42.852773 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:42.866016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] Creating event network-changed:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:15:42.872226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-692616d6-eb03-4952-9c2d-734ada08bddd req-c06ab440-971f-4de9-b4bd-6031e33f425c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 Oct 23 00:15:42.873038 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 438/851] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:42.939987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lazy-loading 'services' on Instance uuid bd21176d-0e92-48fa-8fe9-d21348458b19 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:15:43.058044 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-34deff96-da27-411b-820c-aff9055858ba tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments/3bf4bc04-2be0-47f5-971f-674f3f775c55" status: 202 len: 0 microversion: 2.1 time: 0.222860 Oct 23 00:15:43.062788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 414/852] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:15:42 2022] DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments/3bf4bc04-2be0-47f5-971f-674f3f775c55 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 00:15:43.070834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:43.079386 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:43.095448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:43.095970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:43.096609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:43.097345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:43.097808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:43.098273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:43.134113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:43.134911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:43.145448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:43.146142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:43.146859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:43.147863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:43.148477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:43.149243 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:43.149391 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b00a5f87-aa52-464c-ac9d-f19ca9769d4e tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082904 Oct 23 00:15:43.150190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 439/853] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:15:43 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:15:43.324694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:43.332548 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b5538ba8-aa51-452c-a495-65b3c5733fd9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.204416 Oct 23 00:15:43.333213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 415/854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:43 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:44.162439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:44.164671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:44.173195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.173673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.174103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.174795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.175243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.175657 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.356885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:44.357493 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:44.364833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.365253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.365689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.366385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.366485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0d5986d0-fab7-43fa-b2a7-310f09427617 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.207530 Oct 23 00:15:44.366840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.367265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.367632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 440/855] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:15:44 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments => generated 25 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:15:44.379224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:44.379715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:44.386049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.386535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.386964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.387737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:44.388187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:44.388638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:44.479468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] HTTP exception thrown: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 is not attached to volume 3bf4bc04-2be0-47f5-971f-674f3f775c55 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Request method failure captured: Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments/3bf4bc04-2be0-47f5-971f-674f3f775c55 HTTP/1.1 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZhV8kRH1wwzc04ULXy-IJr9zKwLyF_K17XCPo-WK55oCCRCnBqnR1VMmeH-uud5jgD-F59WCSdCPv3gSJatg3JYcLywXDTvwOs_yQw478_GmQc1Cdv5-zIb-cefrGUttVCuyoxeO-oMXToRG88GDbhBhZOEh1xt5lWTKjXSOA8F7E Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 10a83daa0cad4d0fb210247c411e4c0a Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:15:44.489059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_10a83daa0cad4d0fb210247c411e4c0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 10a83daa0cad4d0fb210247c411e4c0a Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-TestMinimumBasicScenario-37452060-project Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: fb594a081d194e709023dc7c557afe4c Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-TestMinimumBasicScenario-37452060-project Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:15:44.490922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 is not attached to volume 3bf4bc04-2be0-47f5-971f-674f3f775c55 Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'server_id': 'bd21176d-0e92-48fa-8fe9-d21348458b19', 'id': '3bf4bc04-2be0-47f5-971f-674f3f775c55'} Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3bf4bc04-2be0-47f5-971f-674f3f775c55. Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:15:44.491894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 is not attached to volume 3bf4bc04-2be0-47f5-971f-674f3f775c55 Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 is not attached to volume 3bf4bc04-2be0-47f5-971f-674f3f775c55 Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:44.493294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Returning 404 to user: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 is not attached to volume 3bf4bc04-2be0-47f5-971f-674f3f775c55 {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:15:44.494409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7ada672b-0017-4b0e-b999-1e556891fe79 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments/3bf4bc04-2be0-47f5-971f-674f3f775c55" status: 404 len: 154 microversion: 2.1 time: 0.116282 Oct 23 00:15:44.494409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 441/856] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:15:44 2022] DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19/os-volume_attachments/3bf4bc04-2be0-47f5-971f-674f3f775c55 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 00:15:44.678298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:44.686104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ea6cb0a1-6518-4e54-998c-21f76b59c708 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1678 microversion: 2.1 time: 0.334704 Oct 23 00:15:44.686722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 416/857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:44 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:45.646927 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:45.647423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:45.653777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.654258 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.654692 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.656005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.656460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.656910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.681949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:15:45.711048 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:45.711629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:45.719027 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.719519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.720007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.720830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.721291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.721750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.759398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dd57b4c3-e351-4481-a99b-694efeac686f tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 204 len: 0 microversion: 2.1 time: 0.115967 Oct 23 00:15:45.760143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 442/858] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:15:45 2022] DELETE /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:15:45.769039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:45.769743 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:45.775597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.776085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.776543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.777246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.777708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.778117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.918733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:45.927152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-deeee76f-5269-4bcf-ba75-d8ed5115f98c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1655 microversion: 2.1 time: 0.219998 Oct 23 00:15:45.927808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 417/859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:45 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1655 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:45.949425 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:45.950800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:45.956733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:45.957216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:45.957342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2bad615d-6a71-4317-9cb9-d512bc5cfdca tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1554 microversion: 2.1 time: 0.192487 Oct 23 00:15:45.957680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:45.958184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 443/860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:45 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:45.980151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Going to try to start instance {{(pid=118854) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 00:15:46.021313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0549a526-a60f-4e93-8c28-ef592e6319cb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action" status: 202 len: 0 microversion: 2.1 time: 0.074197 Oct 23 00:15:46.021925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 418/861] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:15:45 2022] POST /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 00:15:46.029985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:46.031343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:46.037316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:46.037786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:46.038212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:46.038903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:46.039348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:46.039760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:46.176273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:46.183887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ce4921c9-fb81-4703-9e40-1de2a5c787f5 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1664 microversion: 2.1 time: 0.157774 Oct 23 00:15:46.184443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 444/862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:46 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:46.983050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:46.984356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:46.990710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:46.991190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:46.991625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:46.992307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:46.992806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:46.993231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:47.121464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:47.129273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4b3dee7a-4c53-4d95-afa5-746903cc6c43 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1554 microversion: 2.1 time: 0.151393 Oct 23 00:15:47.129841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 419/863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:46 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:47.207632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:47.208241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:47.214970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:47.215460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:47.215904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:47.216639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:47.217121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:47.217720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:47.429014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:47.437227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-abcab3fe-f8a9-4c02-86be-ea8350a8432a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1664 microversion: 2.1 time: 0.232964 Oct 23 00:15:47.437806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 445/864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:47 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:48.153292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:48.154060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:48.163971 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.164717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.164906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.165746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.166386 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.166875 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.217352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd21176d-0e92-48fa-8fe9-d21348458b19", "name": "network-vif-deleted", "tag": "1ee74db1-8e09-4822-921d-2ca859c0ee09"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:48.227520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.227994 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.228421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.240698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] Creating event network-vif-deleted:1ee74db1-8e09-4822-921d-2ca859c0ee09 for instance bd21176d-0e92-48fa-8fe9-d21348458b19 on hv-cinder-86156 Oct 23 00:15:48.241514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:48.245585 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-54b688f6-8750-4ff4-a671-742784b930b7 req-0137e8f2-97ad-4401-9695-83e4f2de34ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Oct 23 00:15:48.248652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 446/865] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:15:48.249581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a49a0340-d557-4694-a526-4af403e3bd4b tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1512 microversion: 2.1 time: 0.100235 Oct 23 00:15:48.250177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 420/866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:48 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:48.347431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:15:48.348047 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:48.354205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.354688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.355123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.356141 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.356701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.357160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.382759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lazy-loading 'flavor' on Instance uuid 1e2874e1-1d01-4e33-aeb8-390efe327e22 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:15:48.386359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:48.456448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f618d275-5e89-4d3c-9995-804d0eea3c97 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "POST /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22/action" status: 202 len: 0 microversion: 2.1 time: 0.114500 Oct 23 00:15:48.457043 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 447/867] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:15:48 2022] POST /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:15:48.461529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:48.462138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:48.465436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:48.466127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:48.468404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.468404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.468404 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.470228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.470360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.470783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.472305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.472824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.473262 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.473959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:48.474415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:48.474837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:48.689393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:48.693366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:48.697898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-908187ff-847e-4f99-a532-9208358b09e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1664 microversion: 2.1 time: 0.240140 Oct 23 00:15:48.698559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 421/868] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:48 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1664 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:48.701838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-32ed5774-a8bb-4408-8de4-b4af3319342f tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.240456 Oct 23 00:15:48.703008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 448/869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:48 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:49.274150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:49.274704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:49.281088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.281574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.282014 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.282703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.283160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.283590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.316820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.317346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.317784 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.318231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lazy-loading 'fault' on Instance uuid bd21176d-0e92-48fa-8fe9-d21348458b19 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:15:49.358053 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb594a081d194e709023dc7c557afe4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a83daa0cad4d0fb210247c411e4c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:49.366709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b5db8b47-ab8a-403c-b735-0eed2ae2ef57 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 200 len: 1347 microversion: 2.1 time: 0.096480 Oct 23 00:15:49.367264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 422/870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:49 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:49.722856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:49.723440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:49.725213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:49.725824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:49.730099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.730827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.731282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.731889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.731999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.732367 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.732472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.732858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.732975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.734124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:49.734491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:49.734927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:49.739536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:50.163427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:50.168236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:50.171976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c5e0fe41-d140-4504-821d-69228a785af0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1668 microversion: 2.1 time: 0.452409 Oct 23 00:15:50.172572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 449/871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:49 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1668 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:50.176416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2d9c801b-fc24-45fa-9004-c7de35448d96 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.454939 Oct 23 00:15:50.177177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 423/872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:49 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:15:50.392153 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:50.392796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] [instance: bd21176d-0e92-48fa-8fe9-d21348458b19] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:50.398673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:50.399148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:50.399577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:50.400253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:50.400744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:50.401161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:50.414102 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] HTTP exception thrown: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Request method failure captured: Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 HTTP/1.1 Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZhV8kRH1wwzc04ULXy-IJr9zKwLyF_K17XCPo-WK55oCCRCnBqnR1VMmeH-uud5jgD-F59WCSdCPv3gSJatg3JYcLywXDTvwOs_yQw478_GmQc1Cdv5-zIb-cefrGUttVCuyoxeO-oMXToRG88GDbhBhZOEh1xt5lWTKjXSOA8F7E Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 10a83daa0cad4d0fb210247c411e4c0a Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:15:50.415708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_10a83daa0cad4d0fb210247c411e4c0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10a83daa0cad4d0fb210247c411e4c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 10a83daa0cad4d0fb210247c411e4c0a Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-TestMinimumBasicScenario-37452060 Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-TestMinimumBasicScenario-37452060-project Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: fb594a081d194e709023dc7c557afe4c Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-TestMinimumBasicScenario-37452060-project Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. Oct 23 00:15:50.417267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': 'bd21176d-0e92-48fa-8fe9-d21348458b19'} Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:15:50.418170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. Oct 23 00:15:50.419435 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:15:50.420577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Returning 404 to user: Instance bd21176d-0e92-48fa-8fe9-d21348458b19 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:15:50.420577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ded6584b-7202-4128-8014-d4bdc2969ae6 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19" status: 404 len: 111 microversion: 2.1 time: 0.029896 Oct 23 00:15:50.420577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 450/873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:50 2022] GET /compute/v2.1/servers/bd21176d-0e92-48fa-8fe9-d21348458b19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:15:50.425769 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-95755680-1de1-48a5-9fab-497e1d48ef51 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] Calling method '.version_select at 0x7f3f8d7b64c0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:50.445029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-95755680-1de1-48a5-9fab-497e1d48ef51 tempest-TestMinimumBasicScenario-37452060 tempest-TestMinimumBasicScenario-37452060-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-384261082" status: 202 len: 0 microversion: 2.1 time: 0.023050 Oct 23 00:15:50.445621 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 424/874] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 23 00:15:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-384261082 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:15:51.200804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:51.201555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:51.208325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:51.208910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:51.209413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:51.210171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:51.210625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:51.211045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:51.349437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:51.357789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-553b5584-0b83-4a9b-a6a6-8d607021146d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.161226 Oct 23 00:15:51.358384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 451/875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:51 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:52.381933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:52.382685 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:52.389891 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:52.390724 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:52.391377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:52.392186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:52.392824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:52.393353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:52.536370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:52.545670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8a8ac023-c5bc-4af8-a4cf-fd8bdaa453ae tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.168182 Oct 23 00:15:52.552321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 425/876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:52 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:53.569778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:53.570448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:53.583966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:53.584637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:53.585086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:53.585805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:53.586839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:53.587179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:53.758308 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:53.766520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9f059cda-0ac5-4a1d-b8d9-214e735a100c tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.200602 Oct 23 00:15:53.767243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 452/877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:53 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:54.791338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:54.791955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:54.799442 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:54.799942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:54.800371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:54.801101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:54.801555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:54.801972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:55.055722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:55.063671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9066b586-45ac-46e5-b765-ec0e699f6dea tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.277517 Oct 23 00:15:55.064325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 426/878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:54 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:56.086679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:56.087936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:56.095464 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:56.096228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:56.096914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:56.097711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:56.098173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:56.098600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:56.330301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:56.339880 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7e46bac0-ea34-4721-95b1-2e35c4c378df tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.257121 Oct 23 00:15:56.340465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 453/879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:56 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:57.425305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:57.428940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:57.437975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:57.438559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:57.439051 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:57.439855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:57.440384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:57.442161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:57.677470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:57.685717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b4cb7030-5313-4a94-8d9e-ab5c47e6928e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.266274 Oct 23 00:15:57.686291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 427/880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:57 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:58.710036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:58.710559 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:58.717261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:58.717751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:58.718198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:58.718934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:58.719393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:58.719824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:58.886242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:15:58.897397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ed9c5b67-42f4-47f0-af90-45188f69daa7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.191646 Oct 23 00:15:58.897982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 454/881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:58 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:15:59.920766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:15:59.921387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:15:59.927819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:59.928335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:59.928802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:15:59.929490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:15:59.929938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:15:59.930356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:00.061481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:00.069678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-159b790d-f3d8-4bb7-b42a-061427341231 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.152817 Oct 23 00:16:00.070234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 428/882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:15:59 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:01.092912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:01.094233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:01.100797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:01.101282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:01.101722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:01.102424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:01.102885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:01.103310 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:01.241904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:01.249804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-068bd10f-3b7c-4736-b23b-782fee660d66 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.160704 Oct 23 00:16:01.250483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 455/883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:01 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:02.273628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:02.274208 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:02.281095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.282024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.282461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.283153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.283607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.284031 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.412877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:02.420461 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6cde196c-9a62-4360-a7da-743cf4049727 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1510 microversion: 2.1 time: 0.150752 Oct 23 00:16:02.421036 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 429/884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:02 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:02.444354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:02.444978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:02.451312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.451785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.452214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.453104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.453553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.453972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.633650 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118855) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 00:16:02.700601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5ae8f35d-ba28-49f3-95a1-33ea7c4149e2 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "POST /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22/action" status: 202 len: 0 microversion: 2.1 time: 0.259755 Oct 23 00:16:02.701180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 456/885] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 00:16:02 2022] POST /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:16:02.709985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:02.710926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:02.716970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.717450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.717881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.719217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:02.719809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:02.720243 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:02.854833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:02.863258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-580bff13-caf4-4036-8592-4fe416971268 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1518 microversion: 2.1 time: 0.157126 Oct 23 00:16:02.863813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 430/886] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:02 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:03.744312 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:03.744889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:03.747240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:03.754111 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.754589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.755019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.755715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.756166 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.756612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.844983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'services' on Instance uuid 9a68187e-f713-4b13-a817-2fb0bfc21ddd {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:16:03.887528 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:03.888224 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:03.896284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.896940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.897592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.898299 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.898757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.899188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.922901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4f099934-3fa5-411f-b28d-1695149c1e54 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments/3c5ab869-6341-4563-93b1-e55200302582" status: 202 len: 0 microversion: 2.1 time: 0.183420 Oct 23 00:16:03.923681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 457/887] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:16:03 2022] DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments/3c5ab869-6341-4563-93b1-e55200302582 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:16:03.932251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:03.936104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:03.943508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.944002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.944444 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.946005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:03.946471 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:03.946929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:03.981709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-114c4cd2-443a-4609-9a9d-25712fef12d2 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052893 Oct 23 00:16:03.982377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 458/888] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:16:03 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:16:04.065664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:04.073433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-010f0a80-3f08-4ba6-a88e-bc7787e3d2a6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.190261 Oct 23 00:16:04.074005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 431/889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:03 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:04.680470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "name": "network-vif-unplugged", "status": "completed", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:04.690329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:04.690805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:04.691229 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:04.706446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] Creating event network-vif-unplugged:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:16:04.711730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-78b7958e-ce56-4a4c-9e75-39416df1999f req-e8771c54-1372-45a3-aae8-e5ca8b824a32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034856 Oct 23 00:16:04.712415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 459/890] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:04.997605 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:05.001162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:05.003506 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:05.009663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:05.010139 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:05.010520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:05.011228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:05.011683 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:05.012109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:05.047936 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-28706ad4-5ede-4913-a65e-6283363bd34c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055086 Oct 23 00:16:05.048766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 432/891] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:16:04 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:16:05.100648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:05.102873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:05.114502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:05.115064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:05.115569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:05.116524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:05.117326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:05.117898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:05.267447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:05.275292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a00571e0-9955-4baa-94fc-c9f78481de5a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.181173 Oct 23 00:16:05.276044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 460/892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:05 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:06.061539 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:06.063837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:06.070247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.070762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.071179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.071854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.072308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.072770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.102315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d419f70d-f0a7-43ed-9298-7c0345a17eac tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044700 Oct 23 00:16:06.103082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 433/893] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:16:06 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:16:06.186212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:06.186919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:06.194658 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.195254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.195820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.196796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.197365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.197900 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.227485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:16:06.245470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:06.301904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:06.302513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:06.308708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.309199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.309637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.310331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.310954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.311389 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.324839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6f749330-3039-4b98-b48d-38b8c3e92b23 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 204 len: 0 microversion: 2.1 time: 0.141345 Oct 23 00:16:06.330518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 461/894] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:16:06 2022] DELETE /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:16:06.342167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:06.344144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:06.351544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.352173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.352690 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.353593 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:06.354094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:06.354854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:06.507776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:06.517271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1f399322-3664-4df0-aca9-174c1f1635c3 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.219863 Oct 23 00:16:06.517941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 434/895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:06 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:06.532952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:06.541837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b71ae365-4443-4c68-9145-2d6ddae64162 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1688 microversion: 2.1 time: 0.207960 Oct 23 00:16:06.542401 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 462/896] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:06 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:07.540034 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:07.540608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:07.547849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:07.548372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:07.548855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:07.549584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:07.550033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:07.550455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:07.566263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:07.566959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:07.573547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:07.574032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:07.574472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:07.575168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:07.575622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:07.576048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:07.768218 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:07.775929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:07.776088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-218dee81-c871-4f2a-88d1-6407ed0681d5 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.239841 Oct 23 00:16:07.776534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 435/897] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:07 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:07.784016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a6d0bba0-68a8-4101-a2ef-f31d1c553730 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1688 microversion: 2.1 time: 0.222168 Oct 23 00:16:07.784590 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 463/898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:07 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:08.799700 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:08.800300 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:08.807110 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:08.807638 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:08.808083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:08.808616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:08.809041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:08.809233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:08.809342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:08.809685 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:08.815747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:08.816230 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:08.816694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:08.817390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:08.817843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:08.818271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:09.010428 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:09.019154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:09.019564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a09a37d0-f6d7-4119-99ec-2d33b9ed363d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.223810 Oct 23 00:16:09.020152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 436/899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:08 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:09.027054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bdf927fc-b4b0-455e-bd6f-14477ea9c085 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1688 microversion: 2.1 time: 0.222196 Oct 23 00:16:09.027615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 464/900] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:08 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:10.043745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:10.044467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:10.049994 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:10.050973 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:10.053671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:10.054316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:10.054910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:10.055746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:10.056458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:10.057079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:10.058041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:10.058542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:10.058988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:10.059723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:10.060192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:10.060669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:10.412278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:10.420471 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cc51f0a2-43e0-4d66-9ac9-3b00169a5081 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1688 microversion: 2.1 time: 0.374391 Oct 23 00:16:10.421441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 465/901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:10 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1688 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:10.424402 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:10.438469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4a6caf78-eee2-494d-960c-db4b63afeeb4 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.399004 Oct 23 00:16:10.439051 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 437/902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:10 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:10.939346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a68187e-f713-4b13-a817-2fb0bfc21ddd", "name": "network-vif-deleted", "tag": "a6ee9f3c-3e0c-4373-a116-d961e807eb9a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:10.948947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:10.949540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:10.950039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:10.964063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] Creating event network-vif-deleted:a6ee9f3c-3e0c-4373-a116-d961e807eb9a for instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd on hv-cinder-86156 Oct 23 00:16:10.970205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-fb029ba2-8bb1-44f4-a82c-aa7af406e23b req-4ebe0546-9476-43f6-bed5-dd9a2dafdf41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035075 Oct 23 00:16:10.971110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 466/903] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:11.444877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:11.445486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:11.453205 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:11.453877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:11.454426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:11.455267 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:11.455846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:11.456514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:11.493201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:11.493748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:11.494242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:11.494707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'fault' on Instance uuid 9a68187e-f713-4b13-a817-2fb0bfc21ddd {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:16:11.537743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:11.545454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-39bdb53e-3f91-41ce-b327-799e6b29d424 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1335 microversion: 2.1 time: 0.105595 Oct 23 00:16:11.546027 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 438/904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:11 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:11.702159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:11.703465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:11.709864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:11.710357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:11.710794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:11.711491 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:11.711945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:11.712368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:11.851807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:11.860357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b42965b6-31c1-42fe-bbbd-c157428e45d7 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.401549 Oct 23 00:16:11.861124 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 467/905] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:11 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:12.570168 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:12.570782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:12.577187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:12.577864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:12.578307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:12.578999 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:12.579454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:12.579881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:12.612662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:12.613200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:12.614125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:12.614370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'fault' on Instance uuid 9a68187e-f713-4b13-a817-2fb0bfc21ddd {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:16:12.658706 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:12.666717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-17f672e1-a6b4-4299-90b0-4f852cbb119c tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 200 len: 1335 microversion: 2.1 time: 0.100382 Oct 23 00:16:12.667294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 439/906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:12 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:12.883456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:12.884070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:12.890591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:12.891073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:12.891508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:12.892197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:12.892684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:12.893107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:13.027679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:13.036135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-df98f704-93dc-4c58-8048-5f06fdbc14f9 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.156545 Oct 23 00:16:13.036722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 468/907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:12 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:13.695508 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:13.696407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9a68187e-f713-4b13-a817-2fb0bfc21ddd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:13.703831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:13.704307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:13.704777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:13.705463 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:13.705916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:13.706339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:13.710342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:13.721444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] HTTP exception thrown: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Request method failure captured: Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd HTTP/1.1 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXk1DB64OEAO_HayivPa4yPZnDukTjOII3htOFeeqadFEOqR64Ehe_Mm50U0KJvGZFXoIsJj6XeHGetH-BodUiK9ume33fiu7M0ZqUoY2oYVxsyWYjEszyySS1TBVt03CpOhyZpGTaY5bfsPeKf5sZaZV8zqYW2nE1WkUpGicre-0U Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:16:13.723065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08beca89c7f747229a3cc6cb6a363af4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f95f4fc0d5c5428c96545f543139489b Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. Oct 23 00:16:13.724478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '9a68187e-f713-4b13-a817-2fb0bfc21ddd'} Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:16:13.725416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. Oct 23 00:16:13.726959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:13.728527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Returning 404 to user: Instance 9a68187e-f713-4b13-a817-2fb0bfc21ddd could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:16:13.728527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-26498e8a-99af-494a-b147-6999138641c1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd" status: 404 len: 111 microversion: 2.1 time: 0.033893 Oct 23 00:16:13.728527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 440/908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:13 2022] GET /compute/v2.1/servers/9a68187e-f713-4b13-a817-2fb0bfc21ddd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:16:13.734165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-264150b7-4ac2-42ff-9594-a62f2b0bfdc1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '.version_select at 0x7f3f910b01f0>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:13.754450 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-264150b7-4ac2-42ff-9594-a62f2b0bfdc1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229052915" status: 202 len: 0 microversion: 2.1 time: 0.024353 Oct 23 00:16:13.755025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 469/909] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 00:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229052915 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:16:14.060095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:14.060737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:14.067253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:14.067738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:14.068174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:14.068888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:14.069349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:14.069773 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:14.220513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:14.230270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-af5236da-e028-4a7f-b7a6-727efde5bc2d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.174698 Oct 23 00:16:14.230930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 441/910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:14 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:15.256584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:15.257165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:15.264609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:15.266905 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:15.267793 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:15.268887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:15.269547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:15.270157 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:15.420015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:15.430044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fff2ceca-843b-4dcf-82f6-4bd6b2080c62 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.177763 Oct 23 00:16:15.439224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 470/911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:15 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:16.460274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:16.460904 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:16.469372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:16.469902 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:16.470450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:16.471348 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:16.471940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:16.472596 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:16.616334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:16.625726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-98ca606c-784e-4e5a-8929-86d1869e174b tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.169626 Oct 23 00:16:16.626309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 442/912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:16 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:16.771774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "name": "network-vif-plugged", "status": "completed", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:16.784033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:16.784534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:16.785314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:16.798227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] Creating event network-vif-plugged:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:16:16.803392 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-9412b6c9-57c3-4a19-add3-848a66b78096 req-28e57134-433f-48f9-999e-358cbb7abcf5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035307 Oct 23 00:16:16.804383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 471/913] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:16.898698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:16.899201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:16.905497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:16.906054 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:16.906449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:16.907115 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:16.907571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:16.908010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:16.934824 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:16:17.024759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7c1de737-4a40-4f1f-b523-34f6631e57f0 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 204 len: 0 microversion: 2.1 time: 0.129435 Oct 23 00:16:17.025410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 443/914] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:16:16 2022] DELETE /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:16:17.035698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:17.036565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:17.043783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:17.044550 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:17.045181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:17.045885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:17.047865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:17.048301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:17.215235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:17.225408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f91ad7a0-ac51-44af-9c77-e0a6f6f8ed99 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1507 microversion: 2.1 time: 0.194779 Oct 23 00:16:17.226104 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 472/915] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:17 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:17.651788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:17.652645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:17.659053 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:17.659528 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:17.659981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:17.660692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:17.661142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:17.661601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:17.797870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:17.805645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-95987b8b-eb7a-43b0-b94f-44262d8ac414 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.159119 Oct 23 00:16:17.806210 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 444/916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:17 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:18.253980 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:18.254635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:18.260780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:18.261263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:18.261719 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:18.262404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:18.262854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:18.263274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:18.476343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:18.485522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-de6e0fb1-3a29-4f45-9206-3324408ad514 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1507 microversion: 2.1 time: 0.235492 Oct 23 00:16:18.486110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 473/917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:18 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:18.719141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9595d516-aac5-4107-9664-b4c76e761937", "name": "network-vif-deleted", "tag": "0bd87e24-ad08-45e5-a314-9943cb013d2d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:18.728910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:18.729390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:18.729819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:18.741613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] Creating event network-vif-deleted:0bd87e24-ad08-45e5-a314-9943cb013d2d for instance 9595d516-aac5-4107-9664-b4c76e761937 on hv-cinder-86156 Oct 23 00:16:18.746406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-fed29dc4-15f2-4efe-a0c6-5b04cf2d8f0e req-16c17bdd-3a9d-41a3-a123-26684a7465a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031037 Oct 23 00:16:18.747000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 445/918] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:18.830977 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:18.831583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:18.837643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:18.838167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:18.838597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:18.839282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:18.839730 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:18.840148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:18.977596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:18.987944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1f1fcc8a-d577-4b3d-b135-2954c4059e6a tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1576 microversion: 2.1 time: 0.161431 Oct 23 00:16:18.988561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 474/919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:18 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:19.511837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:19.512624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:19.519030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:19.519520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:19.519960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:19.520694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:19.521148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:19.521581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:19.554614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:19.555099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:19.555565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:19.556015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lazy-loading 'fault' on Instance uuid 9595d516-aac5-4107-9664-b4c76e761937 {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:16:19.597692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:19.605537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b25682ec-fd13-4202-a949-0bce18ac0160 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 200 len: 1311 microversion: 2.1 time: 0.098027 Oct 23 00:16:19.606123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 446/920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:19 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:20.011134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:20.011738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:20.018532 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.019010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.019443 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.020121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.020595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.021016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.150932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:20.159571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-44f21eb7-b4a8-4836-b457-43e67c5335e6 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1563 microversion: 2.1 time: 0.152305 Oct 23 00:16:20.160136 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 475/921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:20 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:20.629741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:20.630409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: 9595d516-aac5-4107-9664-b4c76e761937] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:20.636958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.637490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.637981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.638675 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.639129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.639579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.653307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] HTTP exception thrown: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Request method failure captured: Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 HTTP/1.1 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXk1DB64OEAO_HayivPa4yPZnDukTjOII3htOFeeqadFEOqR64Ehe_Mm50U0KJvGZFXoIsJj6XeHGetH-BodUiK9ume33fiu7M0ZqUoY2oYVxsyWYjEszyySS1TBVt03CpOhyZpGTaY5bfsPeKf5sZaZV8zqYW2nE1WkUpGicre-0U Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:16:20.654970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08beca89c7f747229a3cc6cb6a363af4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f95f4fc0d5c5428c96545f543139489b Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. Oct 23 00:16:20.657511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '9595d516-aac5-4107-9664-b4c76e761937'} Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:16:20.658395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. Oct 23 00:16:20.659819 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:20.661190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Returning 404 to user: Instance 9595d516-aac5-4107-9664-b4c76e761937 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:16:20.661190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1fc493e7-0504-410f-8b73-125bbdcc46ce tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937" status: 404 len: 111 microversion: 2.1 time: 0.031764 Oct 23 00:16:20.661190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 447/922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:20 2022] GET /compute/v2.1/servers/9595d516-aac5-4107-9664-b4c76e761937 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:16:20.665651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:20.666154 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:20.672214 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.672739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.673181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.673871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.674330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.674757 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.699917 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:16:20.777260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1d806f47-d50a-4149-873c-edf52a5775d1 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 204 len: 0 microversion: 2.1 time: 0.115119 Oct 23 00:16:20.777959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 476/923] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:16:20 2022] DELETE /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:16:20.786571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:20.787175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:20.793316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.793801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.794241 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.794929 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:20.795385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:20.795809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:20.929896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:20.938201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6bd92235-f94a-4a74-9b57-f260ef3d7333 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1521 microversion: 2.1 time: 0.155517 Oct 23 00:16:20.938791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 448/924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:20 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:21.965178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:21.965891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:21.974574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:21.975074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:21.975508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:21.976212 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:21.976712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:21.977136 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:22.018979 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c788f89c-5620-4a79-aca6-4b2dce29abc0", "name": "network-vif-deleted", "tag": "297fd16c-502d-4af5-8b87-28b1cc7bdb86"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:22.031654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:22.032974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:22.033424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:22.045701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] Creating event network-vif-deleted:297fd16c-502d-4af5-8b87-28b1cc7bdb86 for instance c788f89c-5620-4a79-aca6-4b2dce29abc0 on hv-cinder-86156 Oct 23 00:16:22.045913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95f4fc0d5c5428c96545f543139489b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08beca89c7f747229a3cc6cb6a363af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:22.049974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:22.052441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-23d1e16f-9297-42a2-974f-59a63667a94e req-d52bf73c-ce45-4649-9f0c-4064906f8b61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038000 Oct 23 00:16:22.053480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 449/925] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:16:22.056623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-59d8ab27-820b-4e53-b590-98ca7c85a045 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 200 len: 1479 microversion: 2.1 time: 0.097735 Oct 23 00:16:22.057207 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 477/926] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:21 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 1479 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:23.081426 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:23.082225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] [instance: c788f89c-5620-4a79-aca6-4b2dce29abc0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:23.088891 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:23.089376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:23.089811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:23.090496 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:23.090949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:23.091374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:23.104601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] HTTP exception thrown: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Request method failure captured: Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 HTTP/1.1 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXk1DB64OEAO_HayivPa4yPZnDukTjOII3htOFeeqadFEOqR64Ehe_Mm50U0KJvGZFXoIsJj6XeHGetH-BodUiK9ume33fiu7M0ZqUoY2oYVxsyWYjEszyySS1TBVt03CpOhyZpGTaY5bfsPeKf5sZaZV8zqYW2nE1WkUpGicre-0U Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:16:23.106354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_08beca89c7f747229a3cc6cb6a363af4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/08beca89c7f747229a3cc6cb6a363af4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 08beca89c7f747229a3cc6cb6a363af4 Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1019788861 Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f95f4fc0d5c5428c96545f543139489b Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1019788861-project Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. Oct 23 00:16:23.107924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'c788f89c-5620-4a79-aca6-4b2dce29abc0'} Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:16:23.108711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. Oct 23 00:16:23.110137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:16:23.111396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] Returning 404 to user: Instance c788f89c-5620-4a79-aca6-4b2dce29abc0 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:16:23.111396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c6d2a5ca-1e7a-4d75-95db-7ec33ac450b3 tempest-ServerRescueNegativeTestJSON-1019788861 tempest-ServerRescueNegativeTestJSON-1019788861-project] 10.222.0.13 "GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0" status: 404 len: 111 microversion: 2.1 time: 0.031636 Oct 23 00:16:23.111396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 450/927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:23 2022] GET /compute/v2.1/servers/c788f89c-5620-4a79-aca6-4b2dce29abc0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:16:31.416611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c6ea1f31-a854-4554-b0a8-1fe673f1ff78 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: .version_select at 0x7f3f8d76dd30>, body: {"keypair": {"name": "tempest-keypair-984060042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfBKAQUNQ0MgpGA9hiz9pnxuhvAJGivap1KLZoOcXnXG7Eq1KXB1kiVF9FHHAdzlbwzQRf3Bu61KnEvPDGxM47KY8iIKtIhHkgtqfux+n+8FQcYNM4Mu7FUwWhpCidM8g=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:31.434718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-c6ea1f31-a854-4554-b0a8-1fe673f1ff78 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:16:31.439351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-c6ea1f31-a854-4554-b0a8-1fe673f1ff78 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:16:31.477513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c6ea1f31-a854-4554-b0a8-1fe673f1ff78 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190513 Oct 23 00:16:31.478180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 478/928] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:16:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:33.014814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1436777502", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4edcd026-bef0-4b4d-831f-46b273b092a5"}], "security_groups": [{"name": "tempest-securitygroup--1358275348"}], "key_name": "tempest-keypair-984060042", "user_data": "}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:33.096593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:33.124186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] validate_networks() for [('4edcd026-bef0-4b4d-831f-46b273b092a5', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:16:33.517753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:16:33.518144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:16:33.518620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:16:33.519028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:16:33.519439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:16:33.532269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:33.532642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:33.533086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:33.533837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:33.534296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:33.534735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:33.556339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:16:33.560958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:16:33.572901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:16:33.575470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:16:33.632606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8471dbd4-5be4-4ceb-90fc-42220e3bc98c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622091 Oct 23 00:16:33.635092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 451/929] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:16:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:16:33.647519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1725456f-41dd-434a-85f5-fe57d303f382 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:33.652438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1725456f-41dd-434a-85f5-fe57d303f382 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:33.727564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1725456f-41dd-434a-85f5-fe57d303f382 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:33.736882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1725456f-41dd-434a-85f5-fe57d303f382 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1241 microversion: 2.1 time: 0.094434 Oct 23 00:16:33.752474 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 479/930] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:33 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:34.759846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:34.760460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:34.768380 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:34.769211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:34.769864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:34.770570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:34.771023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:34.771449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:34.839692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:34.848808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3521b9c5-553f-4d61-a520-f1456c59ab70 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1293 microversion: 2.1 time: 0.093335 Oct 23 00:16:34.849859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 452/931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:34 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:35.871891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:35.872411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:35.875234 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:35.880529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:35.881026 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:35.881476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:35.882183 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:35.882645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:35.883081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:36.074629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:36.082373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b9e505e3-9b3b-4aaf-8909-8f819dc8e11e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.214434 Oct 23 00:16:36.083156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 480/932] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:35 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:36.434189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a816e-e95d-4146-a712-5957c4566c67", "tag": "94e38df1-d1c7-4be9-b969-4e9eaa529355"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:36.442321 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:36.446935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:36.447410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:36.447838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:36.460759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] Creating event network-changed:94e38df1-d1c7-4be9-b969-4e9eaa529355 for instance df5a816e-e95d-4146-a712-5957c4566c67 on hv-cinder-86156 Oct 23 00:16:36.465767 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-00b381fb-f063-4995-bd7a-24074c94833c req-1931962c-7531-4215-b9ae-1c98d9af8ec7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035443 Oct 23 00:16:36.466570 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 453/933] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:37.105284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:37.106002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:37.112878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:37.113365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:37.113800 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:37.114492 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:37.114952 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:37.115378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:37.246344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:37.254499 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-aa2b8574-b9bb-4afd-81b4-ba347e8b2a0a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.153097 Oct 23 00:16:37.255061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 481/934] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:37 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:38.278586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:38.279203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:38.287450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:38.287928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:38.288356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:38.289056 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:38.289502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:38.289919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:38.418491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:38.426970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f7a9973c-3263-4ae7-b2f2-016b7c0d5c10 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.152837 Oct 23 00:16:38.427532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 454/935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:38 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:39.449582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:39.450195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:39.456724 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:39.457204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:39.457637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:39.458324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:39.458775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:39.459198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:39.625814 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:39.633611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f4a19d33-12dc-496d-adf3-1a5132b51150 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.187912 Oct 23 00:16:39.634185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 482/936] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:39 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:40.658194 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:40.658794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:40.665204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:40.665680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:40.666109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:40.666791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:40.667236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:40.667651 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:40.803823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:40.811592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d520c9e6-b836-4853-85ed-d7d0a749cde8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.157872 Oct 23 00:16:40.812753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 455/937] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:40 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:41.835088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:41.835703 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:41.842238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:41.842720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:41.843155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:41.844708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:41.845169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:41.845602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:41.976954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:41.985393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a1c5da6b-1713-4b50-9137-193bd55fb87b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.154142 Oct 23 00:16:41.985964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 483/938] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:41 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:42.900451 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a816e-e95d-4146-a712-5957c4566c67", "name": "network-vif-plugged", "status": "completed", "tag": "94e38df1-d1c7-4be9-b969-4e9eaa529355"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:42.911807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:42.912396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:42.912874 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:42.926437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] Creating event network-vif-plugged:94e38df1-d1c7-4be9-b969-4e9eaa529355 for instance df5a816e-e95d-4146-a712-5957c4566c67 on hv-cinder-86156 Oct 23 00:16:42.931571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-bb4149c9-d9ac-495d-9259-815b3d749433 req-2e863dd8-a521-46e7-8fff-dc917b5d8b52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Oct 23 00:16:42.932164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 456/939] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:43.008622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:43.009322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:43.015716 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:43.016276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:43.016817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:43.017523 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:43.017972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:43.018398 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:43.210390 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:43.218103 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-060ba760-83fe-48ab-b2f7-987e19e1cd30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.213410 Oct 23 00:16:43.219423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 484/940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:43 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:44.239806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:44.240664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:44.246099 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:44.246804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:44.254731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:44.255220 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:44.255711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:44.256410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:44.256895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:44.257323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:44.391951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:44.394022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:44.394531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:44.396399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:44.399729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d8535e51-14c9-460b-8506-8e1383d126ab tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1367 microversion: 2.1 time: 0.160858 Oct 23 00:16:44.408563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 457/941] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:44 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:44.408751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:44.408751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:44.408751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:44.408751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:44.409125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:44.409125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:44.429320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-966ff6c0-036c-4620-bbd9-be5f12ab6924 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/ips" status: 200 len: 152 microversion: 2.20 time: 0.039361 Oct 23 00:16:44.429917 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 485/942] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 23 00:16:44 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:16:45.423257 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:45.423859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:45.430292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:45.430768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:45.431201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:45.431881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:45.432331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:45.432785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:45.566173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:45.574079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cc2f3f46-0021-4dc4-a6e3-a1b2472f813f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1556 microversion: 2.1 time: 0.154838 Oct 23 00:16:45.574642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 458/943] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:45 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:45.597279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:45.597866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:45.604018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:45.604514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:45.604949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:45.605623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:45.606070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:45.606495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:45.685263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-995d5fc9-d02a-42ab-a865-60562e5a3565 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091934 Oct 23 00:16:45.686706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 486/944] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:16:45 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:46.277306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:46.277821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:46.283727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:46.284133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:46.284610 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:46.285310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:46.285763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:46.286182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:46.311449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lazy-loading 'flavor' on Instance uuid 0e01d5ec-ec13-4548-8fee-73a21153736d {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:16:46.504008 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-824ed61a-8469-4c08-a824-0835c08944ff tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/action" status: 202 len: 0 microversion: 2.20 time: 0.230560 Oct 23 00:16:46.505060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 459/945] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 00:16:46 2022] POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:16:46.514280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:46.514894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:46.522171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:46.522643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:46.523198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:46.524127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:46.524717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:46.525185 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:46.848985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:46.857193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:46.858908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:46.860099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-774ce5c2-c577-4e75-9d9d-7521f036c10d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.350936 Oct 23 00:16:46.860689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 487/946] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:46 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:46.947429 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a816e-e95d-4146-a712-5957c4566c67", "tag": "94e38df1-d1c7-4be9-b969-4e9eaa529355"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:46.958611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:46.959093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:46.959525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:46.970097 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] Creating event network-changed:94e38df1-d1c7-4be9-b969-4e9eaa529355 for instance df5a816e-e95d-4146-a712-5957c4566c67 on hv-cinder-86156 Oct 23 00:16:46.975080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-1d3684e0-9c03-4339-824b-0b30be49f70e req-34657c24-974b-4d8d-a840-b709faab08d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Oct 23 00:16:46.975888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 460/947] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:47.891067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:47.892269 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:47.898875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:47.899366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:47.899802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:47.900524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:47.900979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:47.901408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:48.041067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:48.049394 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:48.050854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:48.052004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ecfec1df-d80b-4fb9-a5fe-03764fba1a68 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.169139 Oct 23 00:16:48.052574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 488/948] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:47 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:49.077678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:49.079481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:49.086289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:49.086696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:49.087125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:49.087804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:49.088252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:49.088698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:49.216520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:49.224559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:49.225999 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:49.227158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-46fe5e09-802c-4997-aa44-958eabd94052 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.153696 Oct 23 00:16:49.227711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 461/949] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:49 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:50.253132 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:50.253704 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:50.260100 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:50.260683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:50.261122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:50.261812 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:50.262263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:50.262686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:50.389113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:50.397896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:50.399341 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:50.400528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5ec5b216-8487-49b4-a9de-06a84db23c3c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.151868 Oct 23 00:16:50.401091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 489/950] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:50 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:51.426480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:51.427098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:51.433833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:51.434317 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:51.434756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:51.435449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:51.435906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:51.436335 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:51.566899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:51.574989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:51.576424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:51.577606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ba043822-cab3-4650-b1cf-b0092044fa14 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.155173 Oct 23 00:16:51.578162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 462/951] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:51 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:52.603181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:52.603787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:52.611233 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:52.611715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:52.612146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:52.612863 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:52.613314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:52.613732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:52.743738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:52.753002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:52.754518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:52.755846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cb0b9dbe-a641-4335-9f4f-7cb4a0bc678d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.156554 Oct 23 00:16:52.756412 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 490/952] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:52 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:53.781452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:53.781982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:53.788454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.788967 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.789400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.790109 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.790594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.791151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.840782 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:53.843019 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:53.850139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.850616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.851049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.851726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.852175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.852616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.883180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-167e7e0e-3df7-405a-9323-ac28363d497e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046284 Oct 23 00:16:53.883745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 491/953] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:16:53 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 00:16:53.926962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:53.937354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:53.939487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:53.941200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-40cc1950-35da-4446-a924-3b6f0677c99d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.164202 Oct 23 00:16:53.941748 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 463/954] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:53 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:53.950806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:53.951378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:53.957460 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.957995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.958511 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.959267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:53.959725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:53.960151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:53.984728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:16:54.059535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e5485749-b7c2-4c78-bcb4-e91aa939595a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 204 len: 0 microversion: 2.1 time: 0.112044 Oct 23 00:16:54.060195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 492/955] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:16:53 2022] DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:16:54.069456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:54.070067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:54.075916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:54.076401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:54.076878 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:54.077565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:54.078021 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:54.078445 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:54.213843 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:54.222157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-691a1ab8-c6eb-4265-895b-8e5d723c7d62 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1674 microversion: 2.1 time: 0.156641 Oct 23 00:16:54.222726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 464/956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:54 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:54.967641 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:54.968370 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:54.975022 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:54.975500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:54.975934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:54.976668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:54.977133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:54.977553 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:55.109706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:55.118985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:55.120406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:55.121594 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5954b4c1-75b0-49e8-b280-b74cca076737 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.158299 Oct 23 00:16:55.122150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 493/957] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:54 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:55.245710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:55.246245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:55.252766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:55.253250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:55.253693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:55.254420 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:55.254897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:55.255308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:55.384982 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:55.393333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a1f42787-57ca-45a0-9032-40b1e92d4d57 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1674 microversion: 2.1 time: 0.151619 Oct 23 00:16:55.393899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 465/958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:55 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:16:56.147768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:56.148392 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:56.154642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:56.155245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:56.155776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:56.156575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:56.157098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:56.157888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:56.325505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b12f6d-d6e5-426e-8f87-6ce5c17f67f0", "name": "network-vif-deleted", "tag": "a78d73f6-5ef9-4c17-87ef-1ebb3a307639"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:56.340796 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:56.341680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:56.342339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:56.355894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:56.364586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] Creating event network-vif-deleted:a78d73f6-5ef9-4c17-87ef-1ebb3a307639 for instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 on hv-cinder-86156 Oct 23 00:16:56.367300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:56.368925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:56.370479 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-07772b74-1e00-4366-bc91-e9066e937b76 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.226847 Oct 23 00:16:56.370730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-3b73e7d2-97d2-412b-bd17-b9cb56239c4d req-47c55cde-7a71-4a4f-8900-42bb14e2c67c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048751 Oct 23 00:16:56.371818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 494/959] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:56 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:56.388550 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 466/960] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:56.417808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:56.418423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:56.431044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:56.431876 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:56.432528 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:56.433437 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:56.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:56.434704 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:56.458276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:56.506867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:56.515224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-06abd648-de51-4203-b9f3-22caa80a02b7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 200 len: 1322 microversion: 2.1 time: 0.101520 Oct 23 00:16:56.516067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 495/961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:56 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 1322 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:16:57.400137 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:57.400857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:57.407127 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:57.407644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:57.408437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:57.409150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:57.409602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:57.410030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:57.540406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:57.541172 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:57.547262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:57.547832 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:57.548387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:57.548813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:57.549515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:57.549972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:57.550403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:57.555385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:57.556921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:57.558153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8735a82c-b8ce-463b-9f8c-cc91401246f5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.162788 Oct 23 00:16:57.558788 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 467/962] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:57 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:57.564725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 HTTP/1.1 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:16:57.566384 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:16:57.568042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '23b12f6d-d6e5-426e-8f87-6ce5c17f67f0'} Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:16:57.569080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:16:57.570708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:16:57.572074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:16:57.572074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7573f9f1-fd33-4a12-8fd0-ea5f8edc8647 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 404 len: 111 microversion: 2.1 time: 0.031345 Oct 23 00:16:57.572074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 496/963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:16:57 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 00:16:57.581560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-718007c7-6aaf-4d72-a336-a391cb376318 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '.version_select at 0x7f3f8d73e9d0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:57.600599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-718007c7-6aaf-4d72-a336-a391cb376318 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140853283" status: 202 len: 0 microversion: 2.1 time: 0.023656 Oct 23 00:16:57.601169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 468/964] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 00:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140853283 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:16:58.488645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d27d06ec-d290-4b54-8772-a9f683b8c6e7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: .version_select at 0x7f3f8d884790>, body: {"keypair": {"name": "tempest-keypair-1002611593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvZGUaIVVObun8YIit4Poor4PKTKgcwphwZfb1F0sZcgiCggie1NtIxsxp865WrrUO/uu11KI4LrPqTyW6uCMuGocNDEK0ud3tx0CDUAXi6lUwGYXTXRjEAzxkUkvpzLw=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:58.503726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-d27d06ec-d290-4b54-8772-a9f683b8c6e7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:16:58.507575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-d27d06ec-d290-4b54-8772-a9f683b8c6e7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for user f0cf683aa4d14dea974f0febffbbeacc and project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:16:58.529209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d27d06ec-d290-4b54-8772-a9f683b8c6e7 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046194 Oct 23 00:16:58.529809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 497/965] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:16:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:16:58.585625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:58.586524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:58.593002 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:58.593487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:58.593926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:58.594623 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:58.595825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:58.596264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:58.763838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:58.768585 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:58.774413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:58.775838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:58.777037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4abbc406-5ff7-4047-97cc-5c621d6480fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.195892 Oct 23 00:16:58.777592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 469/966] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:58 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:16:59.804168 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:16:59.804848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:16:59.811668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:59.812156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:59.812627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:59.813328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:16:59.814290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:16:59.814722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:16:59.830845 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1546256295", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac5050ac-e38f-4a12-be5a-6131b2b8d4d4"}], "security_groups": [{"name": "tempest-securitygroup--278529021"}], "key_name": "tempest-keypair-1002611593", "user_data": "}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:16:59.976879 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] validate_networks() for [('ac5050ac-e38f-4a12-be5a-6131b2b8d4d4', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:16:59.981405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:59.991121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:59.992577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:16:59.993742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-934041f3-15c2-45ca-8a35-db2e4b77153e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.194019 Oct 23 00:16:59.994299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 498/967] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:16:59 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:00.354307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:17:00.354731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:17:00.355202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:17:00.355611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:17:00.356025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:17:00.365607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:00.366087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:00.366525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:00.367250 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:00.367703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:00.368129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:00.384785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:17:00.388719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Getting quotas for user f0cf683aa4d14dea974f0febffbbeacc and project af0eff3dcaa447a6ad585ffc72f64d78. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:17:00.399590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:17:00.401901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:17:00.448755 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2c5d0f7a-8717-465c-9dab-5998dd3a8bfa tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.622837 Oct 23 00:17:00.449397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 470/968] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:16:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:17:00.461237 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6abd9759-a7a1-40a0-866e-1b1991e10897 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:00.461853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6abd9759-a7a1-40a0-866e-1b1991e10897 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:00.515514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6abd9759-a7a1-40a0-866e-1b1991e10897 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:00.522784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6abd9759-a7a1-40a0-866e-1b1991e10897 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1238 microversion: 2.1 time: 0.065471 Oct 23 00:17:00.523465 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 499/969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:00 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:01.021215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:01.022482 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:01.031135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:01.031639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:01.032077 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:01.033399 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:01.033861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:01.034318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:01.179698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:01.188080 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:01.190344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:01.191520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49e15d9f-3e2b-4f94-adb6-bf7bea65cf1f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.176059 Oct 23 00:17:01.192073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 471/970] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:01 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:01.546153 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:01.546757 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:01.556446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:01.557049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:01.557529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:01.558369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:01.558826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:01.559273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:01.643198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:01.652888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-dc1e52f8-b4c4-4af5-adad-1d45187f91a9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1298 microversion: 2.1 time: 0.110516 Oct 23 00:17:01.653833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 500/971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:01 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:02.218324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:02.218944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:02.225372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:02.225935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:02.226573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:02.227281 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:02.227741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:02.228169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:02.496603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:02.505629 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:02.507069 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:02.508249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-22d0b6f2-add4-48a6-9b74-3be5a2dea41d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.294877 Oct 23 00:17:02.508852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 472/972] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:02 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:02.678534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:02.679085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:02.685584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:02.686069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:02.686509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:02.687196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:02.687654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:02.688081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:02.889315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:02.897771 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-75d74da9-9812-4c73-8297-87267c75a68e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.223157 Oct 23 00:17:02.898371 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 501/973] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:02 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:03.005592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "name": "network-vif-plugged", "status": "completed", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:03.015667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.016128 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.016800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:03.030407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] Creating event network-vif-plugged:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:17:03.035568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-49c54af4-5e85-4293-b3c9-44ed057b99eb req-f1558f07-52cf-491d-9771-3b4a192d82ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035560 Oct 23 00:17:03.036161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 473/974] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:03.197630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89443a21-19a2-4154-9a08-fb353ced38ce", "tag": "3e8ca36e-5a8f-411d-a815-15c78a4ba8e0"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:03.207260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.207859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.208294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:03.219005 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] Creating event network-changed:3e8ca36e-5a8f-411d-a815-15c78a4ba8e0 for instance 89443a21-19a2-4154-9a08-fb353ced38ce on hv-cinder-86156 Oct 23 00:17:03.224164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-ae200ec0-7262-4e49-84e3-6ac48b673233 req-f0f5c2d6-64d1-4de2-bcb7-deb4d0131eaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 Oct 23 00:17:03.225190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 502/975] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:03.537025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:03.553580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:03.554274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.554770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.555212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:03.555910 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.556369 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.556838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:03.730972 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:03.739602 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:03.741671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:03.742857 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ea2b3f17-62bb-4144-84eb-47ea2677b41a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.211429 Oct 23 00:17:03.743421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 474/976] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:03 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:03.922807 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:03.923520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:03.931304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.931792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.932232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:03.933048 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:03.933509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:03.933946 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:04.386051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:04.394774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e10ee1d4-fbfe-4ffc-ba0e-d4066a4d56f9 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.476735 Oct 23 00:17:04.395355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 503/977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:03 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:04.768395 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:04.769020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:04.775421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:04.775895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:04.776325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:04.777030 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:04.777477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:04.777896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:04.911545 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:04.919613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:04.921082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:04.922241 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8ba048ba-b76e-4c3c-bc37-eb2cbfaa8128 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.158288 Oct 23 00:17:04.922792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 475/978] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:04 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:05.418050 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:05.418661 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:05.425816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:05.426300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:05.426740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:05.427432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:05.427891 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:05.428316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:05.555478 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:05.562999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b648b006-cbae-4ccd-813c-fd32fab4cf72 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.148865 Oct 23 00:17:05.563563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 504/979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:05 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:05.948275 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:05.948941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:05.956421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:05.956924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:05.957357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:05.958035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:05.958490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:05.958913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:06.091617 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:06.100279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:06.101791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:06.102962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-641fc981-2dd7-4224-90ad-616c79ea991a tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.158595 Oct 23 00:17:06.103534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 476/980] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:05 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:06.586319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:06.586934 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:06.589372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:06.594595 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:06.595092 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:06.595529 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:06.596213 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:06.596700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:06.597134 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:06.724888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:06.732515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b26e2e78-523c-46c6-8613-78c449c3fade tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.150118 Oct 23 00:17:06.733322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 505/981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:06 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:07.129307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:07.129921 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:07.136323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:07.136834 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:07.137270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:07.137953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:07.138405 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:07.138828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:07.271255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:07.280235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:07.281731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:07.283222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-51039704-6687-4593-a841-9189c78fd94f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1743 microversion: 2.20 time: 0.157950 Oct 23 00:17:07.283642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 477/982] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:07 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:07.757246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:07.757867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:07.765866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:07.766612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:07.767372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:07.768098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:07.768584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:07.769008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:07.958440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:07.966866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c10bcdfb-5d21-465b-972a-9dc579b8dfa2 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.213533 Oct 23 00:17:07.967760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 506/983] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:07 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:17:08.310635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:08.311841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:08.318223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:08.320503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:08.321245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:08.322231 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:08.323336 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:08.324035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:08.324711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:08.583433 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:08.592214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:08.593777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:08.595508 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-520549ba-d7c0-409a-8464-d58e77e91d0e tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.289207 Oct 23 00:17:08.596420 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 478/984] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:08 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:08.995615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:08.997282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:09.004983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:09.005829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:09.006352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:09.007551 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:09.008089 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:09.008630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:09.172205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:09.180518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-793acbdb-5ef6-43ff-8894-138d9e0f80c3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.188950 Oct 23 00:17:09.181090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 507/985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:08 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:09.622586 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:09.623345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:09.631688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:09.632189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:09.633280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:09.634001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:09.634504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:09.635086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:09.790143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:09.799079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:09.800574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:09.801753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-131ab72c-5f42-48c0-9ce5-76f6689181aa tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.183012 Oct 23 00:17:09.805885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 479/986] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:09 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:10.203116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:10.204346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:10.211490 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:10.211977 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:10.212410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:10.213163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:10.213798 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:10.214402 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:10.366753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:10.376399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8a3c32fa-0ea9-43cf-8df2-2feae9ea4abf tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.176704 Oct 23 00:17:10.382317 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 508/987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:10 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:10.827345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:10.827962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:10.829862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:10.830522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:10.837414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:10.837896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:10.838576 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:10.839228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:10.839841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:10.840431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:10.995249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:11.005705 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:11.008083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:11.009509 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4f9f7015-1726-424c-92f0-2c12f4cdef95 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.186299 Oct 23 00:17:11.020722 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 480/988] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:10 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:11.079475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89443a21-19a2-4154-9a08-fb353ced38ce", "name": "network-vif-plugged", "status": "completed", "tag": "3e8ca36e-5a8f-411d-a815-15c78a4ba8e0"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:11.085431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:11.092184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:11.092925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:11.093361 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:11.110973 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] Creating event network-vif-plugged:3e8ca36e-5a8f-411d-a815-15c78a4ba8e0 for instance 89443a21-19a2-4154-9a08-fb353ced38ce on hv-cinder-86156 Oct 23 00:17:11.117018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-55f271fa-ec8e-42a8-913c-3fcc723dc878 req-8a55e6d9-ffa8-48e3-ac10-ffbb197aaaeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041809 Oct 23 00:17:11.117974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 509/989] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:11.405169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:11.406097 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:11.412693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:11.413182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:11.413622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:11.414318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:11.414768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:11.415437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:11.556200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:11.567723 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c7203e33-983e-4092-b897-f1b46a34ac03 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.166404 Oct 23 00:17:11.568615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 481/990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:11 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:12.037190 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:12.037998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:12.044369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:12.047320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:12.047983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:12.048514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:12.048982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:12.049410 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:12.204507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:12.213978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:12.216972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:12.218357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-27aadd54-9e68-4d2e-a48f-a626f5b3acc2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.186942 Oct 23 00:17:12.219408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 510/991] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:12 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:17:12.590852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:12.591467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:12.598064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:12.598968 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:12.599662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:12.600608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:12.601281 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:12.601935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:12.752416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:12.761519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2d1e373c-e688-4086-ba32-3db5a7ca8b1a tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1363 microversion: 2.1 time: 0.174538 Oct 23 00:17:12.762546 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 482/992] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:12 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:13.244744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:13.245378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:13.251884 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.252564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.252828 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:13.253508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.254012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.254667 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:13.394058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:13.403004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:13.404436 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:13.405624 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-27055e11-cb0a-4eaa-8ab6-c1d3091f1657 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.164913 Oct 23 00:17:13.406180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 511/993] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:13 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:13.789352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:13.789915 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:13.796471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.797222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.798392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:13.798392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.798812 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.799237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:13.946466 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:13.954382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1fc42d20-bbfb-4fe6-9738-a52e3326c360 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1548 microversion: 2.1 time: 0.169665 Oct 23 00:17:13.954953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 483/994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:17:13 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:17:13.977770 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:13.978282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:13.984708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.985219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.985844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:13.986720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:13.987175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:13.987601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:14.066484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-15ce1baf-ceeb-4fa4-a4df-40642020a78f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092539 Oct 23 00:17:14.067698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 512/995] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:17:13 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:14.432129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:14.432983 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:14.441905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:14.442713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:14.442831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:14.450135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:14.450687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:14.451513 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:14.707601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:14.717252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:14.718974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:14.721003 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8d2fee5b-1e3f-402c-92cc-6b8470915e20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.293110 Oct 23 00:17:14.729359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 484/996] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:14 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:15.176881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89443a21-19a2-4154-9a08-fb353ced38ce", "tag": "3e8ca36e-5a8f-411d-a815-15c78a4ba8e0"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:15.187671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:15.188155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:15.188901 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:15.201622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] Creating event network-changed:3e8ca36e-5a8f-411d-a815-15c78a4ba8e0 for instance 89443a21-19a2-4154-9a08-fb353ced38ce on hv-cinder-86156 Oct 23 00:17:15.208356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-5294bfce-8a92-4567-8fdd-f1e6ce0dac38 req-6b8c86c5-5d73-48f2-8a1b-37cf20c269cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034513 Oct 23 00:17:15.209596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 513/997] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:15.750579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:15.751176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:15.768060 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:15.768588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:15.769028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:15.770325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:15.771331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:15.771765 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:16.109905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:16.120228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:16.121717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:16.122898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-77570dc4-5b88-43f6-91a4-68b3bc5d93fb tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.376247 Oct 23 00:17:16.136647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 485/998] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:15 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:17.155358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:17.156587 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:17.164404 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:17.165477 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:17.166068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:17.166806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:17.167261 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:17.167685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:17.326325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:17.335670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:17.337243 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:17.338668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-24aee0f9-69ef-413b-957a-879ac96ebeb8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.187769 Oct 23 00:17:17.339701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 514/999] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:17 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:18.365349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:18.366666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:18.373952 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:18.374500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:18.375006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:18.375710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:18.376217 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:18.376674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:18.521756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:18.530136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:18.531580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:18.532803 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1faf3890-51d3-4e1e-abc3-3a44b8a78139 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.172085 Oct 23 00:17:18.533357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 486/1000] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:18 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:19.558845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:19.560093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:19.566378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:19.567112 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:19.567606 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:19.568467 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:19.568948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:19.569383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:19.936770 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:19.945350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:19.946787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:19.947980 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-47d2b994-c625-4557-9663-936f9b230844 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1738 microversion: 2.20 time: 0.393073 Oct 23 00:17:19.948534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 515/1001] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:19 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:20.974974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:20.975589 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:20.982087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:20.982561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:20.982995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:20.983944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:20.984394 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:20.984840 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:21.195893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:21.199339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=100 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:21.205453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:21.206881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:21.209255 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fbd4f502-e862-41d5-ba2a-907c1653994b tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1720 microversion: 2.20 time: 0.238084 Oct 23 00:17:21.209844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 487/1002] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:20 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:22.235483 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:22.236086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:22.243493 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:22.243982 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:22.244418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:22.245151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:22.245625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:22.246046 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:22.380325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:22.388354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:22.389875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:22.391076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e79d438e-ee7c-4ff3-b719-0371ee9914ed tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1720 microversion: 2.20 time: 0.159758 Oct 23 00:17:22.391671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 516/1003] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:22 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:23.068678 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "name": "network-vif-unplugged", "status": "completed", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:23.079448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:23.079920 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:23.080468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:23.093130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] Creating event network-vif-unplugged:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:17:23.098385 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-8d0a11be-bd1f-4781-ac17-4440df690908 req-47698821-506e-4779-a036-73f531809779 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034082 Oct 23 00:17:23.099186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 488/1004] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:23.417173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:23.417866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:23.424776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:23.425253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:23.425685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:23.426370 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:23.428006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:23.428453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:23.432735 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=100 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:23.558827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:23.566936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:23.568589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:23.569747 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1cc60442-f00a-4f48-8276-395c17fb1a4f tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1663 microversion: 2.20 time: 0.156574 Oct 23 00:17:23.570309 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 517/1005] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:23 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:23.594795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e62e9a1-c3c0-4139-b3f7-31f9c24722bb"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:23.597219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:23.603761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:23.604240 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:23.604714 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:23.605393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:23.605842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:23.606258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:23.879007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-392ddabb-e117-467d-b0bf-1c00d5836bb7 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288610 Oct 23 00:17:23.879620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 489/1006] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 23 00:17:23 2022] POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 00:17:24.005509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:24.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:24.011945 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.012429 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.012898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.013592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.014054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.014486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.250986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-93ed5e2b-65b0-4f51-946b-d005f17bf938 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments/0e62e9a1-c3c0-4139-b3f7-31f9c24722bb" status: 202 len: 0 microversion: 2.20 time: 0.249940 Oct 23 00:17:24.251580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 518/1007] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 23 00:17:23 2022] DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments/0e62e9a1-c3c0-4139-b3f7-31f9c24722bb => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:17:24.312365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:24.312989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:24.320235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.320749 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.321182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.321862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.322307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.322727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.352412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118854) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 00:17:24.415013 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-22565249-c745-4002-a46e-b185e15b956c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/action" status: 202 len: 0 microversion: 2.20 time: 0.106579 Oct 23 00:17:24.415618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 490/1008] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 00:17:24 2022] POST /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:17:24.425326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:24.426251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:24.432846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.433319 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.433748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.434433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:24.434883 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:24.435300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:24.570896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:24.580534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:24.582292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:24.584846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-55b962fe-92e2-4229-944c-d85648438fb2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1671 microversion: 2.20 time: 0.163345 Oct 23 00:17:24.585406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 519/1009] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:24 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:25.612277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:25.613066 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:25.620264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:25.620987 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:25.621423 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:25.622113 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:25.622558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:25.623152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:25.757919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:25.765953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:25.767373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:25.768538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a284e2a5-e59a-4f8a-a82a-4ef2e3cf5bcf tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.161248 Oct 23 00:17:25.769112 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 491/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:25 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:26.794305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:26.795686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:26.804317 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:26.805192 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:26.805849 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:26.806936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:26.807612 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:26.808259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:26.963206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:26.972193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:26.974008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:26.977328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e8d6d1d1-d381-4e4c-bfd4-2a90f7afeab5 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.187380 Oct 23 00:17:26.996814 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 520/1011] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:26 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:28.002314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:28.003531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:28.011234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:28.011725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:28.012175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:28.013023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:28.013480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:28.013933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:28.152825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:28.161380 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:28.162886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:28.164184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1698387d-54ef-48b1-9592-f9059c041db2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.165841 Oct 23 00:17:28.164810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 492/1012] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:27 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:29.189954 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:29.190658 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:29.197281 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:29.197764 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:29.198204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:29.198909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:29.199468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:29.199795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:29.336684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:29.345049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:29.346501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:29.347679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-50eecd9c-3201-4524-a842-4f21285d7863 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.161670 Oct 23 00:17:29.348245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 521/1013] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:29 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:30.374966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:30.376163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:30.383862 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:30.384346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:30.384807 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:30.385505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:30.385955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:30.386373 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:30.528833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:30.537153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:30.538648 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:30.539985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-452de229-83ab-438f-95ad-7dcecfa9ee45 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.169022 Oct 23 00:17:30.540580 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 493/1014] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:30 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:31.566008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:31.566614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:31.573979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:31.574459 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:31.575065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:31.575923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:31.576373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:31.576820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:31.719150 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:31.728565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:31.730014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:31.731197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b56aa5f1-a35a-45e7-bf42-2aae6fadb2fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.169120 Oct 23 00:17:31.731818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 522/1015] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:31 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:32.757201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:32.759198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:32.765780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:32.766316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:32.766790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:32.767480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:32.767940 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:32.768398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:32.903247 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:32.911886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:32.914102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:32.915436 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-a840c8e0-c3a3-4697-b081-b7b81afec9f3 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.162144 Oct 23 00:17:32.928543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 494/1016] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:32 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:33.940576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:33.941223 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:33.948613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:33.949199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:33.949717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:33.950536 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:33.951082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:33.951573 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:34.091184 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:34.099363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:34.100829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:34.102671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0600a04d-4d6c-4d4e-aa94-111b2e56aadd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.166275 Oct 23 00:17:34.103864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 523/1017] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:33 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:35.128808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:35.129785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:35.136859 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:35.137353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:35.137795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:35.138496 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:35.138963 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:35.139692 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:35.295050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:35.304731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:35.306191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:35.307364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c2a465e7-7286-40da-a85a-dbdab8adef63 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.182515 Oct 23 00:17:35.307924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 495/1018] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:35 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:36.332887 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:36.333520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:36.340561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:36.341035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:36.341463 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:36.342140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:36.342589 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:36.343010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:36.476646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:36.484888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:36.486314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:36.487461 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5922c140-6268-408f-bfdf-e38f849acc8d tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.158509 Oct 23 00:17:36.488018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 524/1019] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:36 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:37.513584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:37.514193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:37.520672 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:37.521155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:37.521620 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:37.522304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:37.523267 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:37.523702 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:37.652645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:37.660638 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:37.662072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:37.663225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0fa65fcc-bd96-4777-a777-685638668208 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.153538 Oct 23 00:17:37.663774 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 496/1020] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:37 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:17:38.688816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:38.689421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:38.691713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=40 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:38.697504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:38.697987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:38.698423 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:38.699118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:38.699570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:38.699996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:38.828516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:38.837114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:38.838560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:38.839722 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-deb9ed04-e1d7-4902-9922-d7dcef4498fc tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.154907 Oct 23 00:17:38.840277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 525/1021] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:38 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:39.865677 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:39.866282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:39.869447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:39.874555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:39.875027 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:39.875457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:39.876140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:39.876659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:39.877079 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:40.010479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:40.018450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:40.019870 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:40.021057 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ae77a13c-c3db-423d-8214-690cd5294aa0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.159328 Oct 23 00:17:40.021613 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 497/1022] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:39 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:17:41.047292 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:41.047833 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:41.054277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:41.054759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:41.055200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:41.056418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:41.056902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:41.057331 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:41.185625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:41.193731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:41.195177 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:41.197228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a45f81d1-28c7-4686-8ceb-f4426f30a503 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.153055 Oct 23 00:17:41.197817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 526/1023] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:41 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:42.223018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:42.223663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:42.230360 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:42.230852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:42.231292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:42.231990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:42.232446 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:42.232899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:42.364930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:42.373346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:42.374785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:42.375991 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1c460654-7d11-4eaf-a9eb-4fc3c0bed449 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.156877 Oct 23 00:17:42.376593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 498/1024] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:42 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:43.401968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:43.402409 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:43.408754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:43.409236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:43.409670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:43.410353 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:43.410802 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:43.411223 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:43.538655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:43.547206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:43.548701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:43.549850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7b823659-9c3b-4126-b5b4-462930454527 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.152610 Oct 23 00:17:43.550419 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 527/1025] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:43 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:44.576413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:44.576970 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:44.583430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:44.583905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:44.584334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:44.585047 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:44.585497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:44.585919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:44.719382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:44.727690 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:44.729172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:44.730339 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-abb34f4a-f9b9-4df7-8166-663fe4bb81b6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.159073 Oct 23 00:17:44.730906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 499/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:44 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:45.279137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "name": "network-vif-plugged", "status": "completed", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:17:45.291582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:45.292051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:45.292475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:45.303428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] Creating event network-vif-plugged:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:17:45.309445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-5419f687-676c-4f3c-906b-3f0189bfde8b req-1f0c8316-1003-42e5-bee0-d057b397fe64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034065 Oct 23 00:17:45.310327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 528/1027] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:17:45.756577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:45.757110 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:45.763674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:45.764158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:45.764627 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:45.765319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:45.765776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:45.766203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:45.895595 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:45.904297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:45.905731 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:45.906913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-10b9a5b1-6118-4e79-a854-ffd880a8b946 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.154443 Oct 23 00:17:45.907469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 500/1028] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:45 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:46.932257 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:46.932975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:46.940811 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:46.941295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:46.941728 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:46.943144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:46.943602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:46.944028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:47.101643 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:47.115962 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:47.117456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:47.118645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7b7b5761-74c6-49a1-9fae-e4805c95acd8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1729 microversion: 2.20 time: 0.190668 Oct 23 00:17:47.119206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 529/1029] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:46 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:17:48.146304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:17:48.146911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:17:48.153016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:48.153487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:48.153926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:48.154599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:17:48.155064 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:17:48.155581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:17:48.173607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:48.286713 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:48.294985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:48.297266 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:17:48.298468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-48c1592e-4c84-4674-8872-5a6eba93e103 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1716 microversion: 2.20 time: 0.156135 Oct 23 00:17:48.299028 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 501/1030] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:17:48 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:18:05.450903 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:05.451428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:05.454762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:05.455188 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=9 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:05.456116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:05.461269 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=9 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:05.462295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:05.464020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:05.464020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:05.464737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:05.465711 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:05.466235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:05.466742 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:05.470045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:05.470564 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:05.471043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:05.484470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] Creating event network-changed:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:18:05.490212 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-ed6d37bc-7942-4fcd-ad75-21ba5b32c5bd req-6c557bb1-2a0b-4af6-9b38-dcf95882bf2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Oct 23 00:18:05.491193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 502/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:18:05.497732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:18:05.585902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3baad026-08bd-408c-932f-f06237acfccd tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 204 len: 0 microversion: 2.1 time: 0.138830 Oct 23 00:18:05.587009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 530/1032] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:18:05 2022] DELETE /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:18:05.596005 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:05.597532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:05.605173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:05.605683 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:05.606756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:05.607545 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:05.608011 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:05.608714 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:05.807483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:05.816263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-19afeeeb-52ef-4503-8a49-be1c7bc85704 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.224802 Oct 23 00:18:05.816985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 503/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:05 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:06.839799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:06.840520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:06.847617 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:06.848108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:06.848565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:06.849263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:06.849720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:06.850179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:07.043625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:07.052018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-626bbfd7-9b4f-4509-b31c-424c4d19c831 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1569 microversion: 2.1 time: 0.216470 Oct 23 00:18:07.052608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 531/1034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:06 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:07.884884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2874e1-1d01-4e33-aeb8-390efe327e22", "name": "network-vif-deleted", "tag": "102a9cab-b2e4-4996-8b79-c7122fbd4a6a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:07.898230 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:07.898715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:07.899163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:07.914308 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] Creating event network-vif-deleted:102a9cab-b2e4-4996-8b79-c7122fbd4a6a for instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 on hv-cinder-86156 Oct 23 00:18:07.919726 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-56321945-dcf2-4ce5-9b3e-5c39b8869605 req-10baf869-ae67-4a65-925b-87532106fb0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038744 Oct 23 00:18:07.921331 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 504/1035] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:08.075625 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:08.076195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:08.082808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:08.083240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:08.083676 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:08.084366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:08.084843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:08.085266 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:08.160599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd59419dfebe46a28caad71b1454c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401b24ace154000a2b9e80e785f1ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:08.170377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c10a8f78-15a0-4958-92f0-0c6a0c14ca8e tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 200 len: 1220 microversion: 2.1 time: 0.098392 Oct 23 00:18:08.171417 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 532/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:08 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:09.195980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:09.196728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] [instance: 1e2874e1-1d01-4e33-aeb8-390efe327e22] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:09.203306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:09.203925 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:09.204297 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:09.205010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:09.205845 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:09.206273 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:09.219631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] HTTP exception thrown: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Request method failure captured: Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 HTTP/1.1 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIaWfFqU_xEB91KNgqpC-cwKQJPT-1UYOuJnNtwiIQDVL7GuiykvVspqtx5rn94zJsj6HBr91kFjxkbMgn04zodOv_Sqoh4tKcVljrm8ahpIYbp5itc0SCAgDsNwrOq3lOL4DpuzMDQ86zvM9gUzYumiWu0Am22wCwLuLMcdqNHWKpc Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 0401b24ace154000a2b9e80e785f1ce9 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-TestShelveInstance-710108307 Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:18:09.221124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0401b24ace154000a2b9e80e785f1ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0401b24ace154000a2b9e80e785f1ce9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0401b24ace154000a2b9e80e785f1ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0401b24ace154000a2b9e80e785f1ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-TestShelveInstance-710108307 Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 0401b24ace154000a2b9e80e785f1ce9 Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-TestShelveInstance-710108307 Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-TestShelveInstance-710108307-project Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: cd59419dfebe46a28caad71b1454c53a Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-TestShelveInstance-710108307-project Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. Oct 23 00:18:09.222802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '1e2874e1-1d01-4e33-aeb8-390efe327e22'} Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:18:09.223668 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. Oct 23 00:18:09.225200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:09.226555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Returning 404 to user: Instance 1e2874e1-1d01-4e33-aeb8-390efe327e22 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:18:09.226555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-43c0fa7e-3737-44ac-9a35-b1154bccfc16 tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22" status: 404 len: 111 microversion: 2.1 time: 0.030745 Oct 23 00:18:09.226555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 505/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:09 2022] GET /compute/v2.1/servers/1e2874e1-1d01-4e33-aeb8-390efe327e22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:18:09.383023 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ced05318-9e5a-46b8-be98-0ac14f44012d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] Calling method '.version_select at 0x7f3f8d8f1790>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:09.401834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ced05318-9e5a-46b8-be98-0ac14f44012d tempest-TestShelveInstance-710108307 tempest-TestShelveInstance-710108307-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1818066054" status: 202 len: 0 microversion: 2.1 time: 0.022637 Oct 23 00:18:09.406160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 533/1038] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 23 00:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1818066054 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:18:20.650133 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:20.650694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:20.652964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=8 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:20.653606 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=12 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:20.659809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:20.660287 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:20.660813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:20.661499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:20.661957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:20.662375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:20.685138 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c60e93cf-2dd9-47fc-aa6c-baea6c73d28e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/ips" status: 200 len: 148 microversion: 2.1 time: 0.039048 Oct 23 00:18:20.685698 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 506/1039] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:18:20 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:22.059854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:18:22.060393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments (ip 10.222.0.13) !!! Oct 23 00:18:22.061128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:22.062000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:22.066792 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0209b61-9f71-4c19-866f-07f86e5e3f2e"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:22.069098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:22.080290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:22.080790 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:22.081228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:22.081915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:22.082366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:22.082787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:22.324105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7abe3ec2-3cb9-4591-afad-56acb2728944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265538 Oct 23 00:18:22.324867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 534/1040] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:18:22 2022] POST /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:29.875916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8d1c2614-282e-4594-b89a-324da2a08d5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: .version_select at 0x7f3f8d7154c0>, body: {"keypair": {"name": "tempest-keypair-270881784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPME4uDwLWEKdzKvIy2nEb7cLhur9KeZjEsXE+nn2Z1MjSe2L5MxJjfH9XMZsTgYRlgiI/V8te2MRLi2BV6xOZEldmssg/lWGv5F2kcuxIVeDgpeqneItUXewsQiErXw9g=="}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:29.892182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-8d1c2614-282e-4594-b89a-324da2a08d5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:18:29.895945 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-8d1c2614-282e-4594-b89a-324da2a08d5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:18:29.917527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8d1c2614-282e-4594-b89a-324da2a08d5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045394 Oct 23 00:18:29.918124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 507/1041] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:18:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:31.419938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-866329846", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4edcd026-bef0-4b4d-831f-46b273b092a5"}], "security_groups": [{"name": "tempest-securitygroup--636962224"}], "key_name": "tempest-keypair-270881784", "user_data": "}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:31.523946 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] validate_networks() for [('4edcd026-bef0-4b4d-831f-46b273b092a5', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:18:31.905116 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:18:31.905545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:18:31.906023 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:18:31.906434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:18:31.906854 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:18:31.916140 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:31.916658 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:31.917099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:31.917825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:31.918280 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:31.918706 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:31.936414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:18:31.940378 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:18:31.951303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:18:31.953717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:18:32.003403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f9a2fce9-cb3e-4aea-b46d-dfd1a74950d9 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.588037 Oct 23 00:18:32.004169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 535/1042] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:18:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:18:32.015283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b1227261-3afe-44e6-8c1f-d971d4529e20 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:32.015890 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b1227261-3afe-44e6-8c1f-d971d4529e20 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:32.018315 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=4 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:32.079010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b1227261-3afe-44e6-8c1f-d971d4529e20 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:32.087200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b1227261-3afe-44e6-8c1f-d971d4529e20 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1240 microversion: 2.1 time: 0.075747 Oct 23 00:18:32.087785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 508/1043] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:32 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:33.113037 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:33.113655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:33.123354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:33.124115 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:33.124649 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:33.125406 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:33.126070 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:33.126622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:33.216754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:33.227527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-48cd2b77-d2c7-42a3-9139-7def524a41c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1310 microversion: 2.1 time: 0.120277 Oct 23 00:18:33.228264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 536/1044] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:33 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1310 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:18:34.251497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:34.252656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:34.258974 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:34.259458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:34.259893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:34.260611 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:34.261067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:34.261499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:34.475803 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:34.483741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6247be90-a2b2-496c-bd5f-75bbbaea55c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.236192 Oct 23 00:18:34.484363 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 509/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:34 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:34.822278 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3968a159-b75e-495a-a029-f3508332ca6c", "tag": "58836ac2-6366-4ab4-b6bb-bb55800f980c"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:34.835588 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:34.836074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:34.836524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:34.849484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] Creating event network-changed:58836ac2-6366-4ab4-b6bb-bb55800f980c for instance 3968a159-b75e-495a-a029-f3508332ca6c on hv-cinder-86156 Oct 23 00:18:34.854304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-a798bd45-c1f2-4f64-87d4-4dad4c97a699 req-f6091e6e-a630-44a6-aafd-4f89c7b392e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036005 Oct 23 00:18:34.855090 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 537/1046] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:35.508439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:35.509061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:35.515354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:35.515829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:35.516258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:35.516969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:35.517417 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:35.517855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:35.648161 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:35.655844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-80478c7f-df77-4f86-bd25-f0cbe9d3f770 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.151290 Oct 23 00:18:35.656416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 510/1047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:35 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:36.680843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:36.681544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:36.687629 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:36.688113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:36.688583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:36.689273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:36.690354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:36.690780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:36.820795 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:36.828327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a7b62a20-d3c5-4f49-91d2-2393ae6d36b5 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.152267 Oct 23 00:18:36.828925 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 538/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:36 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:37.851758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:37.852401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:37.863016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:37.863575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:37.864023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:37.864756 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:37.865216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:37.865644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:38.083801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:38.092078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1906487f-8406-4067-a51f-9f729f02ad93 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.244292 Oct 23 00:18:38.092928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 511/1049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:37 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:39.117411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:39.118028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:39.124431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:39.124947 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:39.125381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:39.126067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:39.126517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:39.127564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:39.254271 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:39.262025 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9a77b793-5cbd-4478-be9f-bfb86a6deed2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.148431 Oct 23 00:18:39.262615 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 539/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:39 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:39.734681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3968a159-b75e-495a-a029-f3508332ca6c", "name": "network-vif-plugged", "status": "completed", "tag": "58836ac2-6366-4ab4-b6bb-bb55800f980c"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:39.746324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:39.747032 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:39.747486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:39.760382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] Creating event network-vif-plugged:58836ac2-6366-4ab4-b6bb-bb55800f980c for instance 3968a159-b75e-495a-a029-f3508332ca6c on hv-cinder-86156 Oct 23 00:18:39.765446 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-97102291-f0e9-4924-808b-e81dcefb5f34 req-f0cf1c53-49f0-489b-b043-040b47afae72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Oct 23 00:18:39.766204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 512/1051] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:18:40.286002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:40.286538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:40.292938 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:40.293420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:40.293853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:40.294540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:40.294993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:40.295451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:40.427343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:40.434989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-01c0bfa7-3afc-41b6-80f2-e3cc630a5530 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.153492 Oct 23 00:18:40.435556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 540/1052] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:40 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:41.458469 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:41.459166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:41.465302 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:41.465776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:41.466206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:41.466881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:41.467327 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:41.467745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:41.598485 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:41.606055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-03820ded-7b0e-4a46-8e5e-9a226d1ec61f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1365 microversion: 2.1 time: 0.152292 Oct 23 00:18:41.606608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 513/1053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:41 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:42.631231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:42.631767 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:42.634129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:42.634822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:42.640393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:42.640898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:42.641328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:42.642009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:42.642456 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:42.643067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:42.778697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:42.786821 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e60609af-1d36-4d7e-bf5c-8e4e0ab7c7f3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1554 microversion: 2.1 time: 0.160308 Oct 23 00:18:42.787387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 541/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:18:42 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:42.809922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:42.810480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:42.812522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:42.818410 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:42.818897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:42.819334 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:42.820023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:42.820479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:42.820930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:42.898561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-bbddf9a0-7d6c-4986-b5de-8032469016a1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092551 Oct 23 00:18:42.899174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 514/1055] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:18:42 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:44.052760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3968a159-b75e-495a-a029-f3508332ca6c", "tag": "58836ac2-6366-4ab4-b6bb-bb55800f980c"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:44.062502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:44.063011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:44.063442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:44.074598 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] Creating event network-changed:58836ac2-6366-4ab4-b6bb-bb55800f980c for instance 3968a159-b75e-495a-a029-f3508332ca6c on hv-cinder-86156 Oct 23 00:18:44.079639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-a0b39e23-cb97-4b4b-9333-205e47e5f095 req-d28f4bca-8313-4dea-b8d5-dadef88ff716 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031164 Oct 23 00:18:44.080305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 542/1056] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:45.146992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:45.147490 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:45.153555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:45.154044 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:45.154487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:45.155177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:45.155635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:45.156065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:45.179464 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-41b4be30-d988-4a37-8e76-245715732b32 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/ips" status: 200 len: 144 microversion: 2.1 time: 0.037521 Oct 23 00:18:45.180024 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 515/1057] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:18:45 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:46.512713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ad44408-5f35-48e9-88d3-546202a2a0e6"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:46.515096 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:46.522007 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:46.522486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:46.522916 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:46.523599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:46.524051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:46.524475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:46.767298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f0ab83d1-7f68-4ae2-addb-f3a62c1f23eb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259098 Oct 23 00:18:46.770892 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 543/1058] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:18:46 2022] POST /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:54.328382 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:54.330575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:54.333262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:54.338517 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:54.338990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:54.339421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:54.340100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:54.340572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:54.340992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:54.371251 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c968b502-8af3-4014-b73c-dc332d5a4622 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Oct 23 00:18:54.371730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 516/1059] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:18:54 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:54.384069 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:54.384959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:54.386856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:54.392336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:54.392845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:54.394622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:54.395399 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:54.395889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:54.396320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:54.399648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:54.428171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c06c22b6-ea33-48a4-9b90-3b0505a65235 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6" status: 200 len: 194 microversion: 2.1 time: 0.049023 Oct 23 00:18:54.428796 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 544/1060] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 00:18:54 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:55.632665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:55.634797 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:55.641198 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.641684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.642124 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.642814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.644029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.644468 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.673306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-95efe862-20b2-4932-a958-2ac5cd7782fd tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044700 Oct 23 00:18:55.673851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 517/1061] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 00:18:55 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:18:55.741488 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:55.742073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:55.748414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.748940 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.749376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.750061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.750516 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.750939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.762654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49236ed7-0973-4741-a243-7b34c9e01184"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:55.765098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:55.771674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.772157 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.772626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.773320 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.773776 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.774201 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.777433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:18:55.855999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1b72a9d3-5c98-4f93-b970-718c043ca7b2 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 204 len: 0 microversion: 2.20 time: 0.117791 Oct 23 00:18:55.856648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 545/1062] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 00:18:55 2022] DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 00:18:55.866760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:55.867472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:55.873325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.873806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.874241 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:55.874929 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:55.875415 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:55.875839 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:56.010295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:56.018336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:56.019857 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:56.021057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b4729cc6-fd73-4c24-8384-02ada7b13db0 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.159510 Oct 23 00:18:56.021619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 546/1063] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:18:55 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:18:57.046846 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:57.047527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:57.054596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:57.055067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:57.055498 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:57.056182 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:57.056655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:57.057075 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:57.090061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-60acc6ed-dc41-4ea2-b8c5-b69d94dfc1a0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "POST /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.331124 Oct 23 00:18:57.090716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 518/1064] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:18:55 2022] POST /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:18:57.208082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:57.216359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:57.217844 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:57.219020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0ed83390-1d60-4349-ac61-7ec636ab7ad1 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1722 microversion: 2.20 time: 0.176104 Oct 23 00:18:57.219572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 547/1065] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:18:57 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 00:18:58.246684 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:58.247522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:58.254318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:58.255558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:58.256067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:58.256789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:58.257245 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:58.257669 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:58.344197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:58.352462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:58.353935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ef165353f4f1189400c005519c2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55445c398b424025b2588386af037755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:18:58.355116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-727b08d4-d2b7-44c1-8969-11ae395552da tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 200 len: 1655 microversion: 2.20 time: 0.113190 Oct 23 00:18:58.368574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 519/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:18:58 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 00:18:58.415468 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e01d5ec-ec13-4548-8fee-73a21153736d", "name": "network-vif-deleted", "tag": "c084a59b-eafe-4545-8923-83928980d978"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:18:58.431084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:58.431572 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:58.432001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:58.445245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] Creating event network-vif-deleted:c084a59b-eafe-4545-8923-83928980d978 for instance 0e01d5ec-ec13-4548-8fee-73a21153736d on hv-cinder-86156 Oct 23 00:18:58.450263 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-eb2f860d-7e5a-4628-ab82-20c98a1e6728 req-6c61702a-75b3-4a6e-92a0-ab5855d4f9a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Oct 23 00:18:58.450991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 548/1067] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:18:59.383899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:59.384514 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:18:59.392214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:59.392214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:59.392583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:59.393277 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:18:59.393885 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:18:59.394312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:18:59.409119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d HTTP/1.1 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:18:59.411376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:18:59.413175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '0e01d5ec-ec13-4548-8fee-73a21153736d'} Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:18:59.414136 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:18:59.415697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:18:59.417196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:18:59.417196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-811576dc-3d15-46f4-ba0f-929d326958a4 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 404 len: 111 microversion: 2.20 time: 0.033770 Oct 23 00:18:59.417196 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 520/1068] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:18:59 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:18:59.423334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3e7ce38a-9afb-4e6b-be89-799cd9e6a4e6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '.version_select at 0x7f3f910e9f70>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:18:59.445941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3e7ce38a-9afb-4e6b-be89-799cd9e6a4e6 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400624086" status: 204 len: 0 microversion: 2.20 time: 0.026674 Oct 23 00:18:59.446683 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 549/1069] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 23 00:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400624086 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 00:19:01.197593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:01.198100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:01.204475 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:01.204969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:01.205412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:01.206104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:01.206561 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:01.206989 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:01.221043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d HTTP/1.1 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:19:01.222588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.224309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '0e01d5ec-ec13-4548-8fee-73a21153736d'} Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:01.225268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.226794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.228263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:01.228263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1770e221-e2f0-4496-8d3f-5f1154896853 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 404 len: 111 microversion: 2.20 time: 0.030356 Oct 23 00:19:01.228263 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 521/1070] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 00:19:01 2022] DELETE /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:19:01.232507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:01.233253 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 0e01d5ec-ec13-4548-8fee-73a21153736d] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:01.240686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:01.241167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:01.241600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:01.242286 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:01.242739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:01.243163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:01.259011 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d HTTP/1.1 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:19:01.260663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.262330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '0e01d5ec-ec13-4548-8fee-73a21153736d'} Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:01.263145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. Oct 23 00:19:01.264375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:01.265520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 0e01d5ec-ec13-4548-8fee-73a21153736d could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:01.265520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-5db367eb-ab26-461d-ac1d-ebcf953e7f20 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d" status: 404 len: 111 microversion: 2.20 time: 0.033427 Oct 23 00:19:01.265520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 550/1071] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:19:01 2022] GET /compute/v2.1/servers/0e01d5ec-ec13-4548-8fee-73a21153736d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:19:02.402206 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:02.402717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:02.409119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:02.409603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:02.410038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:02.411365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:02.411822 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:02.412252 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:02.416355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:19:02.430746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 HTTP/1.1 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:19:02.432379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.434086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '71d26bbe-0243-4653-9465-2afd08fcce15'} Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:02.434900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.436151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.437501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:02.437501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-538609e4-a5ac-43e0-9255-820b85198e4c tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 404 len: 111 microversion: 2.20 time: 0.035497 Oct 23 00:19:02.437501 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 522/1072] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 00:19:02 2022] DELETE /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:19:02.443006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:02.443662 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] [instance: 71d26bbe-0243-4653-9465-2afd08fcce15] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:02.450197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:02.450665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:02.451174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:02.451871 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:02.452447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:02.452972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:02.467057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] HTTP exception thrown: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Request method failure captured: Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 HTTP/1.1 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIXiH2V4qd-_x6pg3aFV6kUb1Q9bunyEjvC4juh0ttGzwhy8zVruhDnl96RhTsMc6lGhKZTNzkQGBHGi3RzZmEEQ82bYM-Z02PdBpYehN5zFAnaQzWJDbdMurr_ly_0Ybzqz-aytq3SaNL-MLhBGO2a_ltoAR67qZswUlcAMjZcgWhQ Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:19:02.468627 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55445c398b424025b2588386af037755", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55445c398b424025b2588386af037755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55445c398b424025b2588386af037755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 55445c398b424025b2588386af037755 Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024347084 Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 8b4ef165353f4f1189400c005519c2ac Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024347084-project Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.470297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '71d26bbe-0243-4653-9465-2afd08fcce15'} Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:02.471142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. Oct 23 00:19:02.472603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:02.473785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] Returning 404 to user: Instance 71d26bbe-0243-4653-9465-2afd08fcce15 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:02.473785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-74409714-c619-4798-b2e2-20e90b54fef8 tempest-AttachVolumeShelveTestJSON-2024347084 tempest-AttachVolumeShelveTestJSON-2024347084-project] 10.222.0.13 "GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15" status: 404 len: 111 microversion: 2.20 time: 0.031488 Oct 23 00:19:02.473785 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 551/1073] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 00:19:02 2022] GET /compute/v2.1/servers/71d26bbe-0243-4653-9465-2afd08fcce15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:19:04.699798 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:04.702095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:04.710676 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:04.711163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:04.711837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:04.712572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:04.713279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:04.713716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:04.746311 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6a156ec3-5637-40ac-9341-1d872f9c22b0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050366 Oct 23 00:19:04.746883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 523/1074] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:19:04 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:19:05.019165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:05.019753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:05.027282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:05.027765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:05.028242 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:05.028914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:05.029370 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:05.029794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:05.060170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fae34fdb-9fab-4dba-890a-4566fb7d988d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6" status: 200 len: 194 microversion: 2.1 time: 0.044921 Oct 23 00:19:05.060843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 552/1075] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 00:19:05 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:19:05.072102 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:05.072626 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:05.078457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:05.078955 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:05.079396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:05.080086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:05.080572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:05.081004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:05.166965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lazy-loading 'services' on Instance uuid 89443a21-19a2-4154-9a08-fb353ced38ce {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:19:05.240540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6ed1f194-c044-4abe-acd9-cfccbd4fd0fb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6" status: 202 len: 0 microversion: 2.1 time: 0.172130 Oct 23 00:19:05.241192 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 524/1076] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:19:05 2022] DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/7ad44408-5f35-48e9-88d3-546202a2a0e6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:19:06.383145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:06.383775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:06.390159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:06.390634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:06.391060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:06.391751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:06.392194 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:06.392640 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:06.423049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3bc170fa-4b8a-4a33-91f4-abfa1c0bae4d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/49236ed7-0973-4741-a243-7b34c9e01184" status: 200 len: 194 microversion: 2.1 time: 0.045703 Oct 23 00:19:06.423621 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 553/1077] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 00:19:06 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/49236ed7-0973-4741-a243-7b34c9e01184 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:19:06.435846 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:06.436424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:06.443546 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:06.444026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:06.444459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:06.445189 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:06.445636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:06.446055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:06.529166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lazy-loading 'services' on Instance uuid 89443a21-19a2-4154-9a08-fb353ced38ce {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:19:06.606896 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e7b6d5b8-7c11-4d08-9853-c4a0ed5606ff tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/49236ed7-0973-4741-a243-7b34c9e01184" status: 202 len: 0 microversion: 2.1 time: 0.175669 Oct 23 00:19:06.607483 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 525/1078] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:19:06 2022] DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments/49236ed7-0973-4741-a243-7b34c9e01184 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:19:07.785660 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:07.787808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:07.794274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:07.794757 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:07.795188 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:07.795875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:07.796325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:07.796772 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:07.827074 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-c2f4b85d-eb38-466e-a2e5-00b6822c6cc1 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045286 Oct 23 00:19:07.827628 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 554/1079] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:19:07 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:19:07.951346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:07.953694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:07.960283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:07.960792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:07.961225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:07.961905 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:07.962353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:07.962771 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:07.991279 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-96fb95a4-8ad3-4f31-aba9-a6dc2f2b0a0f tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044690 Oct 23 00:19:07.991820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 526/1080] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:19:07 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:19:08.056403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:08.056919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:08.062772 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:08.063249 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:08.063679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:08.064359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:08.064835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:08.065256 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:08.090004 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:19:08.164536 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e2907cd8-9458-41f9-b602-14c5125cb51d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 204 len: 0 microversion: 2.1 time: 0.111358 Oct 23 00:19:08.165039 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 555/1081] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:19:08 2022] DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:19:08.173534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:08.174152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:08.180836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:08.181323 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:08.181763 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:08.182457 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:08.182918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:08.183351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:08.318608 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:08.326390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-8a72c883-eac7-40fe-876d-ef19d8228df8 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1672 microversion: 2.1 time: 0.156757 Oct 23 00:19:08.326959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 527/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:08 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:09.350789 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:09.351519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:09.357889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:09.358358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:09.358791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:09.359470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:09.359915 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:09.360333 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:09.492614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:09.500320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-68a06a38-367f-406a-b35c-ee3eabf015e3 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1672 microversion: 2.1 time: 0.154333 Oct 23 00:19:09.500910 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 556/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:09 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:10.524601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:10.525246 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:10.531864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:10.532234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:10.532730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:10.533481 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:10.533951 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:10.534380 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:10.674232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:10.682653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f5a1fd2b-3806-4f4c-a0c3-f23971a8b29d tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1672 microversion: 2.1 time: 0.162113 Oct 23 00:19:10.683238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 528/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:10 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:19:11.218365 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89443a21-19a2-4154-9a08-fb353ced38ce", "name": "network-vif-deleted", "tag": "3e8ca36e-5a8f-411d-a815-15c78a4ba8e0"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:19:11.229124 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:11.229599 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:11.230032 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:11.242270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] Creating event network-vif-deleted:3e8ca36e-5a8f-411d-a815-15c78a4ba8e0 for instance 89443a21-19a2-4154-9a08-fb353ced38ce on hv-cinder-86156 Oct 23 00:19:11.248148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-326f55d1-13c8-4485-8e9b-6cfef4fa28c7 req-4e7cb7b5-8e9e-4f6f-9db5-c053eb336d86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174904 Oct 23 00:19:11.249084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 557/1085] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:19:11.706529 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:11.707078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:11.714286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:11.714782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:11.715214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:11.715917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:11.716374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:11.716829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:11.779343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:11.787681 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6fd49854-2499-40b9-b41c-7ee5ee72dddb tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1605 microversion: 2.1 time: 0.085093 Oct 23 00:19:11.788278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 529/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:11 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:12.813095 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:12.813793 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:12.821057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:12.821538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:12.821985 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:12.822674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:12.823125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:12.823549 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:12.885341 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:12.893014 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b8969f09-0e4e-4466-9691-35d33855266e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1323 microversion: 2.1 time: 0.084593 Oct 23 00:19:12.893576 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 558/1087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:12 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1323 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:13.915738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:13.916349 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:13.922737 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:13.923219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:13.923657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:13.924343 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:13.924826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:13.925261 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:13.955584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:13.956068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:13.956568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:13.957020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lazy-loading 'fault' on Instance uuid 89443a21-19a2-4154-9a08-fb353ced38ce {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:19:13.997010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:14.005371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e5d96bc3-50a9-4853-905e-24506f7939e0 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1328 microversion: 2.1 time: 0.093396 Oct 23 00:19:14.005944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 530/1088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:13 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:15.028922 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:15.029535 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:15.036851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:15.037330 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:15.037765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:15.038454 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:15.038914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:15.039339 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:15.070786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:15.071260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:15.071694 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:15.072132 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lazy-loading 'fault' on Instance uuid 89443a21-19a2-4154-9a08-fb353ced38ce {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:19:15.116466 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf683aa4d14dea974f0febffbbeacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0eff3dcaa447a6ad585ffc72f64d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:19:15.124181 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-19eaab83-4d4c-41fa-a482-2886abddc967 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 200 len: 1328 microversion: 2.1 time: 0.099149 Oct 23 00:19:15.124784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 559/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:15 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:19:16.147659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:16.148356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:16.155050 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:16.155612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:16.156122 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:16.156923 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:16.157447 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:16.157946 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:16.171961 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce HTTP/1.1 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:19:16.173665 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:16.175371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '89443a21-19a2-4154-9a08-fb353ced38ce'} Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:16.180262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:16.182117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:16.183519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:16.183519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-114eda7b-2780-4542-9075-caa3b326f0ba tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 404 len: 111 microversion: 2.1 time: 0.032569 Oct 23 00:19:16.183519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 531/1090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:16 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:19:16.185414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ebece3b9-ae9d-4227-a9cc-6eb1c8f3b26e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '.version_select at 0x7f3f91021700>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:16.205085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ebece3b9-ae9d-4227-a9cc-6eb1c8f3b26e tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002611593" status: 202 len: 0 microversion: 2.1 time: 0.023468 Oct 23 00:19:16.205673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 560/1091] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 00:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002611593 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:19:19.122286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:19.123542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:19.130048 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:19.131056 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:19.131533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:19.132242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:19.132738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:19.133169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:19.147276 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce HTTP/1.1 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:19:19.148884 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.150503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '89443a21-19a2-4154-9a08-fb353ced38ce'} Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:19.151450 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.152781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.154295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:19.154295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1de22285-ca64-4abb-abe4-0dc60da26911 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 404 len: 111 microversion: 2.1 time: 0.031739 Oct 23 00:19:19.154295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 532/1092] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:19:19 2022] DELETE /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:19:19.159389 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:19.159998 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 89443a21-19a2-4154-9a08-fb353ced38ce] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:19.167602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:19.168175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:19.168689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:19.169600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:19.170053 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:19.170480 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:19.184127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce HTTP/1.1 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:19:19.185827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.187809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '89443a21-19a2-4154-9a08-fb353ced38ce'} Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:19.189254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. Oct 23 00:19:19.190932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:19.192527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 89443a21-19a2-4154-9a08-fb353ced38ce could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:19.192527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-91f16e7f-ae20-4bcf-bde4-a15f2b3afa09 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce" status: 404 len: 111 microversion: 2.1 time: 0.032431 Oct 23 00:19:19.192527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 561/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:19 2022] GET /compute/v2.1/servers/89443a21-19a2-4154-9a08-fb353ced38ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:19:20.329811 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:20.330332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:20.337526 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:20.338091 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:20.338557 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:20.339355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:20.339914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:20.340392 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:20.355619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 HTTP/1.1 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:19:20.357202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.358598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '23b12f6d-d6e5-426e-8f87-6ce5c17f67f0'} Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:20.361129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.363284 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.364693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:20.364693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-70cf4503-a7bd-4e68-a7d1-6b7dd5be6211 tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 404 len: 111 microversion: 2.1 time: 0.032969 Oct 23 00:19:20.364693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 533/1094] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:19:20 2022] DELETE /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:19:20.370051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:19:20.370668 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] [instance: 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:19:20.377250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:20.377734 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:20.378174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:20.378870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:19:20.379322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:19:20.379748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:19:20.394180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] HTTP exception thrown: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Request method failure captured: Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 HTTP/1.1 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIZnNy1vCL-h8s6cJ3Rd2FbXP9806VOCCJZ698zqPEKJmxaFio7BU9LKUfZ7hDPb7ChyGbnxFRD25eaERSDqBmWFg6WqUGy6PwGNueB8a7xHEcd47YHL_l2WU4PsNqAX6U3Ybt371zQD7Q8PYPsmPygjd2Jvdt8kvhNRPr0vck6HM5s Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:19:20.395715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af0eff3dcaa447a6ad585ffc72f64d78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af0eff3dcaa447a6ad585ffc72f64d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: af0eff3dcaa447a6ad585ffc72f64d78 Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1411855297 Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: f0cf683aa4d14dea974f0febffbbeacc Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeTestJSON-1411855297-project Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.397652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '23b12f6d-d6e5-426e-8f87-6ce5c17f67f0'} Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:19:20.398403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. Oct 23 00:19:20.399653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:19:20.400841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] Returning 404 to user: Instance 23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:19:20.400841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2844d265-2a53-4a8c-b067-4f631e4bc04c tempest-AttachVolumeTestJSON-1411855297 tempest-AttachVolumeTestJSON-1411855297-project] 10.222.0.13 "GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0" status: 404 len: 111 microversion: 2.1 time: 0.033511 Oct 23 00:19:20.400841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 562/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:19:20 2022] GET /compute/v2.1/servers/23b12f6d-d6e5-426e-8f87-6ce5c17f67f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:20:39.630430 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=37 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:20:39.631163 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:20:39.632061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:20:39.632197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Sun Oct 23 00:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/ips (ip 10.222.0.13) !!! Oct 23 00:20:39.643332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:39.643826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:39.651516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.652000 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.652435 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.653159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.653618 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.654740 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.678043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ef07117a-9779-4404-95e6-ac985f2cd29a tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/ips" status: 200 len: 149 microversion: 2.1 time: 0.049402 Oct 23 00:20:39.678614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 534/1096] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:20:39 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:20:39.688083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:20:39.688870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:20:39.694737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0209b61-9f71-4c19-866f-07f86e5e3f2e"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:39.697137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:39.706322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.706803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.707236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.707924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.708380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.708841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.794651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: POST /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/os-volume_attachments HTTP/1.1 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 74 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:20:39.796723 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {"volumeAttachment": {"volumeId": "a0209b61-9f71-4c19-866f-07f86e5e3f2e"}} Oct 23 00:20:39.798259 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'server_id': '3968a159-b75e-495a-a029-f3508332ca6c', 'body': {'volumeAttachment': {'volumeId': 'a0209b61-9f71-4c19-866f-07f86e5e3f2e'}}} Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:39.799175 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:39.800729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 400 to user: Invalid volume: volume a0209b61-9f71-4c19-866f-07f86e5e3f2e is already attached to instances: df5a816e-e95d-4146-a712-5957c4566c67 {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4e2165c0-d705-4380-be91-5c981bee9ed1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112019 Oct 23 00:20:39.802248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 563/1097] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:20:39 2022] POST /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:20:39.806872 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:39.807368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:39.814641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.815123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.815559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.816246 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.816728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.817156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.842078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:20:39.917188 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e342c1eb-cee8-4356-bc39-abb770de591f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 204 len: 0 microversion: 2.1 time: 0.113842 Oct 23 00:20:39.917821 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 535/1098] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:20:39 2022] DELETE /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 00:20:39.926326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:39.926939 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:39.933744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.934227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.934662 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:39.935848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:39.936298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:39.936783 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:40.064877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:40.072501 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-162220d0-7d59-489e-9697-00738f105e7f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1679 microversion: 2.1 time: 0.150004 Oct 23 00:20:40.073062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 564/1099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:39 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:41.099292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:41.100641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:41.107775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:41.108687 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:41.109434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:41.110354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:41.111010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:41.111632 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:41.250021 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:41.257785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-55ffdbd1-60bc-42bb-8833-5348fead42d6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1679 microversion: 2.1 time: 0.162806 Oct 23 00:20:41.258357 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 536/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:41 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:42.282455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:42.283327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:42.290834 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:42.291324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:42.291768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:42.292476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:42.292959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:42.293387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:42.361707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:42.371710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4af47194-b8a4-4e92-94b5-75b4e2ee282d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 200 len: 1612 microversion: 2.1 time: 0.094387 Oct 23 00:20:42.374358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 565/1101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:42 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 1612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:42.443092 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3968a159-b75e-495a-a029-f3508332ca6c", "name": "network-vif-deleted", "tag": "58836ac2-6366-4ab4-b6bb-bb55800f980c"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:42.455085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:42.455850 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:42.456275 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:42.468549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] Creating event network-vif-deleted:58836ac2-6366-4ab4-b6bb-bb55800f980c for instance 3968a159-b75e-495a-a029-f3508332ca6c on hv-cinder-86156 Oct 23 00:20:42.473949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-cf16410a-07eb-4090-a5a7-d57667b4c583 req-0a94e5fc-cafe-4377-a77d-7fdcf0ee3c03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Oct 23 00:20:42.474634 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 537/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:20:43.397003 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:43.398227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:43.405169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:43.405653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:43.406270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:43.407147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:43.407769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:43.408189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:43.424077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c HTTP/1.1 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:20:43.426342 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:20:43.427838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '3968a159-b75e-495a-a029-f3508332ca6c'} Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:20:43.428774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:20:43.430470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:43.432359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:20:43.432359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bd562120-b5cf-4d6f-bff1-77867205f26b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 404 len: 111 microversion: 2.1 time: 0.034547 Oct 23 00:20:43.432359 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 566/1103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:43 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:20:43.438082 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b9a786b8-e80e-43b2-b2ef-fbcaf2f1b306 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '.version_select at 0x7f3f8d845af0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:43.461087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b9a786b8-e80e-43b2-b2ef-fbcaf2f1b306 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270881784" status: 202 len: 0 microversion: 2.1 time: 0.028094 Oct 23 00:20:43.462199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 538/1104] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 00:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270881784 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:20:44.115071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:44.115568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:44.121514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:44.121990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:44.122424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:44.123780 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:44.124231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:44.124685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:44.202484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lazy-loading 'services' on Instance uuid df5a816e-e95d-4146-a712-5957c4566c67 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:20:44.273870 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ce89a9dd-0032-4195-a139-e3f4478be863 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments/a0209b61-9f71-4c19-866f-07f86e5e3f2e" status: 202 len: 0 microversion: 2.1 time: 0.162994 Oct 23 00:20:44.274447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 567/1105] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:20:44 2022] DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments/a0209b61-9f71-4c19-866f-07f86e5e3f2e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:20:44.283400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:44.285711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:44.292313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:44.292820 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:44.293298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:44.293990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:44.294572 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:44.295460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:44.326594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-39a8d5c6-ad06-4171-b283-5294c4611b5f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Oct 23 00:20:44.327427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 539/1106] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:20:44 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:20:45.340240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:45.343174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:45.349364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.349841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.350267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.350941 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.351387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.351801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.383852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-405ac3ea-e521-49a0-9f5f-b9283a51a228 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048315 Oct 23 00:20:45.384328 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 568/1107] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:20:45 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:20:45.447213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:45.447757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:45.454006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.454477 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.454913 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.455592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.456039 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.456460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.480612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:20:45.554628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7e8b86cc-6691-45b5-9be7-8aef3c1980cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 204 len: 0 microversion: 2.1 time: 0.110918 Oct 23 00:20:45.555207 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 540/1108] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:20:45 2022] DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:20:45.565041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:45.565654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:45.571610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.572093 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.572540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.573223 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:45.573666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:45.574083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:45.703291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:45.710919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-24f509f6-abfd-41fc-bbde-c6d006529018 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1680 microversion: 2.1 time: 0.151189 Oct 23 00:20:45.711485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 569/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:45 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:46.737295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:46.737988 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:46.744238 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:46.744750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:46.745181 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:46.745855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:46.746298 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:46.746719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:46.878065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:46.885817 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-275755bf-b1a9-47c8-8581-cf3241acdc13 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1680 microversion: 2.1 time: 0.153590 Oct 23 00:20:46.886378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 541/1110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:46 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:47.910161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:47.910778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:47.917413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:47.917896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:47.918329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:47.919017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:47.919534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:47.920178 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:47.986305 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:47.994575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fde429a2-3934-409d-9e93-ed963c158467 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 200 len: 1612 microversion: 2.1 time: 0.088162 Oct 23 00:20:47.995162 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 570/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:47 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:48.392941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a816e-e95d-4146-a712-5957c4566c67", "name": "network-vif-deleted", "tag": "94e38df1-d1c7-4be9-b969-4e9eaa529355"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:48.405476 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:48.406344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:48.406958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:48.423164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] Creating event network-vif-deleted:94e38df1-d1c7-4be9-b969-4e9eaa529355 for instance df5a816e-e95d-4146-a712-5957c4566c67 on hv-cinder-86156 Oct 23 00:20:48.430599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-a3587555-a598-4d9c-a9e7-ebc255e36c24 req-1659b6e5-4d37-4cd1-a634-c7e570296866 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041445 Oct 23 00:20:48.431766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 542/1112] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:20:49.018797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:49.019421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:49.025801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:49.026392 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:49.026838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:49.027519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:49.027963 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:49.028383 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:49.043314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 HTTP/1.1 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:20:49.046209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:20:49.047867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': 'df5a816e-e95d-4146-a712-5957c4566c67'} Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:20:49.048712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:20:49.049964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:20:49.051121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:20:49.051121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-368fdbf9-8dac-41e2-a1bb-a80d53bf585c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 404 len: 111 microversion: 2.1 time: 0.032686 Oct 23 00:20:49.051121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 571/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:49 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:20:49.057270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-03bc3afb-7481-463d-a7b3-dd0be9e4b3f7 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '.version_select at 0x7f3f8d73e940>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:49.075693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-03bc3afb-7481-463d-a7b3-dd0be9e4b3f7 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984060042" status: 202 len: 0 microversion: 2.1 time: 0.022584 Oct 23 00:20:49.076916 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 543/1114] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 00:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984060042 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:20:49.714760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e93188d9-08f1-4f54-8f26-262ee80378e1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: .version_select at 0x7f3f91021700>, body: {"keypair": {"name": "tempest-keypair-724586078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4NfDFpF4lf248+Ug8ARLeHHY+rgXYvSENkuy+hz9GX+IBlKF2E216EJ/dEdW31kta5noHbivme0WDZ4otL4Sy3Pl8i9lEYrPnO7KqnGt1G/QMqdLqfT9fwP87brqQ9g=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:49.731068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-e93188d9-08f1-4f54-8f26-262ee80378e1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:20:49.735689 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-e93188d9-08f1-4f54-8f26-262ee80378e1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:20:49.759149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e93188d9-08f1-4f54-8f26-262ee80378e1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048266 Oct 23 00:20:49.760097 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 572/1115] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:20:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:20:51.113537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-101920666", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4edcd026-bef0-4b4d-831f-46b273b092a5"}], "security_groups": [{"name": "tempest-securitygroup--953327498"}], "key_name": "tempest-keypair-724586078", "user_data": "}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:51.237767 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] validate_networks() for [('4edcd026-bef0-4b4d-831f-46b273b092a5', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:20:51.746841 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:20:51.747271 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:20:51.748285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:20:51.748741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:20:51.749158 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:20:51.758142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:51.758624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:51.759062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:51.759795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:51.760249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:51.760706 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:51.777877 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:20:51.781851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:20:51.792793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:20:51.795232 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:20:51.845098 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-19b2ca2e-4c24-4544-876f-ec49f77b23e0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.736397 Oct 23 00:20:51.845745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 544/1116] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:20:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 00:20:51.857120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fac5c7c4-b403-488a-a4de-a10e25d8e738 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:51.857842 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fac5c7c4-b403-488a-a4de-a10e25d8e738 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:51.917512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fac5c7c4-b403-488a-a4de-a10e25d8e738 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:51.924514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fac5c7c4-b403-488a-a4de-a10e25d8e738 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1240 microversion: 2.1 time: 0.071424 Oct 23 00:20:51.925566 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 573/1117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:51 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:52.948132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:52.948806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:52.955492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:52.955969 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:52.956592 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:52.957278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:52.957723 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:52.958173 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:53.020519 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:53.028147 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-29b207ee-2afc-4b6e-9cc5-3cedef4e73cb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1244 microversion: 2.1 time: 0.084407 Oct 23 00:20:53.028744 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 545/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:52 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:54.052177 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:54.052768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:54.059128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:54.059632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:54.060063 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:54.060989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:54.061433 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:54.061852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:54.122918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:54.130571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6199816d-5947-42c5-840a-b0d7ce3cbf26 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1292 microversion: 2.1 time: 0.082747 Oct 23 00:20:54.131125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 574/1119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:54 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:55.153845 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:55.154409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:55.160964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:55.161462 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:55.161901 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:55.162596 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:55.163055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:55.163486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:55.304869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:55.313975 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0cbee715-982f-4982-a706-590fa68d658c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.164034 Oct 23 00:20:55.314777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 546/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:55 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:20:55.719495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa38ebe-250a-4b15-ab03-629f7278d6cd", "tag": "3c3602f1-3e7e-4141-8b02-5e981db529ce"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:20:55.730571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:55.731322 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:55.731765 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:55.745270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] Creating event network-changed:3c3602f1-3e7e-4141-8b02-5e981db529ce for instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd on hv-cinder-86156 Oct 23 00:20:55.751495 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-142c3fde-fb4d-4733-8d98-52c6c9fc9e67 req-17837bef-f0d6-4298-ac13-f3d3d708126f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Oct 23 00:20:55.752654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 575/1121] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:20:56.340703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:56.341313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:56.348223 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:56.348800 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:56.349224 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:56.349915 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:56.350370 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:56.350802 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:56.483735 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:56.491603 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-986294eb-2f7f-4989-a9a6-1def694a51b3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.154857 Oct 23 00:20:56.492159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 547/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:56 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:57.516755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:57.517486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:57.523642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:57.524122 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:57.524583 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:57.525267 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:57.525717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:57.526139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:57.654601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:57.662210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e06dc143-f3d4-4cbf-a716-1c4b7c0afb52 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.150825 Oct 23 00:20:57.662768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 576/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:57 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:58.687160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:58.687847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:58.694431 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:58.694911 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:58.695340 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:58.696027 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:58.696512 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:58.696941 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:58.833203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:20:58.840994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-58a3ca99-42ad-42f1-b52b-49f6e04ece21 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.159408 Oct 23 00:20:58.841697 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 548/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:58 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:20:59.863076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:20:59.863684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:20:59.870393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:59.870864 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:59.871294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:20:59.871969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:20:59.872414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:20:59.872868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:00.010626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:21:00.018654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-49fdbe2e-0cc0-421c-b5d6-d15be3b0e7a4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.159264 Oct 23 00:21:00.019167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 577/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:20:59 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:21:00.998325 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa38ebe-250a-4b15-ab03-629f7278d6cd", "name": "network-vif-plugged", "status": "completed", "tag": "3c3602f1-3e7e-4141-8b02-5e981db529ce"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:21:01.008375 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:01.009035 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:01.009568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:01.022181 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] Creating event network-vif-plugged:3c3602f1-3e7e-4141-8b02-5e981db529ce for instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd on hv-cinder-86156 Oct 23 00:21:01.027182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-df8037c1-7853-4099-a930-63ed0074192c req-e74de107-e2b6-4964-afd0-e1953d5a40d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160824 Oct 23 00:21:01.027777 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 549/1126] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:21:01.042071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:21:01.042687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:21:01.049681 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:01.050169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:01.050648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:01.051351 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:01.051808 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:01.052236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:01.204646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:21:01.212619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3f1bd4c5-ae32-4160-9c8c-dd9eca25dccd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.174371 Oct 23 00:21:01.213268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 578/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:21:01 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:21:02.234190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:21:02.234942 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:21:02.241414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:21:02.242093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:21:02.249472 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:02.249958 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:02.250388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:02.251087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:02.251534 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:02.251957 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:02.386378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:21:02.394906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5ef2b318-f880-4208-ac38-d0610b648041 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1365 microversion: 2.1 time: 0.161602 Oct 23 00:21:02.395482 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 550/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:21:02 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:21:03.417617 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:21:03.418160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:21:03.420086 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:21:03.425936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:03.426414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:03.426851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:03.427536 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:03.427986 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:03.428411 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:03.565836 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:21:03.573737 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-44d719a4-64e4-4fff-b79e-6a44bed299c4 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1554 microversion: 2.1 time: 0.160057 Oct 23 00:21:03.574296 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 579/1129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:21:03 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:21:03.596422 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:21:03.598734 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:21:03.605746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:03.606239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:03.606657 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:03.607358 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:03.607803 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:03.608219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:03.693219 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-21dd22e3-da4e-4d39-9aef-7c0f6f44f4c2 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100607 Oct 23 00:21:03.693917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 551/1130] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:21:03 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:21:04.723603 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa38ebe-250a-4b15-ab03-629f7278d6cd", "tag": "3c3602f1-3e7e-4141-8b02-5e981db529ce"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:21:04.733485 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:21:04.733963 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:21:04.734400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:21:04.747372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] Creating event network-changed:3c3602f1-3e7e-4141-8b02-5e981db529ce for instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd on hv-cinder-86156 Oct 23 00:21:04.752274 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-c3498b89-6c9a-487e-82a6-108b845c6653 req-e63f9918-fb9d-4929-a318-95b6e2289eeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096069 Oct 23 00:21:04.752969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 580/1131] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:20.410875 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:20.411541 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:20.575828 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:20.576322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:20.582234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:20.582707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:20.583134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:20.583815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:20.584262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:20.584711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:20.607129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c718fb8b-ee91-46be-9859-32387132746d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/ips" status: 200 len: 149 microversion: 2.1 time: 0.198237 Oct 23 00:22:20.607673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 552/1132] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:22:20 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/ips => generated 149 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:21.941088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:21.941829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:21.943041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:22:21.943205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:22:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments (ip 10.222.0.13) !!! Oct 23 00:22:21.950524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f38f5806-d68a-44fb-a63d-fccaa397811d"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:21.952973 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:21.962155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:21.962635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:21.963073 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:21.963762 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:21.964250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:21.964776 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:22.204634 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b99c4956-2a46-4652-b90a-0e6d68f8cb5d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265321 Oct 23 00:22:22.205238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 581/1133] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:22:21 2022] POST /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:29.747324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f38f5806-d68a-44fb-a63d-fccaa397811d"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:29.750919 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:29.757485 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:29.757959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:29.758390 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:29.759068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:29.759517 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:29.759939 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:29.841184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: POST /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments HTTP/1.1 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 74 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:22:29.842948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {"volumeAttachment": {"volumeId": "f38f5806-d68a-44fb-a63d-fccaa397811d"}} Oct 23 00:22:29.844806 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'server_id': '7aa38ebe-250a-4b15-ab03-629f7278d6cd', 'body': {'volumeAttachment': {'volumeId': 'f38f5806-d68a-44fb-a63d-fccaa397811d'}}} Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:22:29.845772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:29.847106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 400 to user: Invalid volume: volume f38f5806-d68a-44fb-a63d-fccaa397811d is already attached to instances: 7aa38ebe-250a-4b15-ab03-629f7278d6cd {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-04ce420c-6be4-492f-8a70-bf03ede8e493 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101266 Oct 23 00:22:29.848865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 553/1134] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:22:29 2022] POST /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:22:29.910948 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:29.911533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:29.917890 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:29.918369 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:29.918806 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:29.919513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:29.919959 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:29.921440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:30.001135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lazy-loading 'services' on Instance uuid 7aa38ebe-250a-4b15-ab03-629f7278d6cd {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:22:30.072732 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-bfc338b9-fe86-4d37-b0d5-66c8063ae15d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments/f38f5806-d68a-44fb-a63d-fccaa397811d" status: 202 len: 0 microversion: 2.1 time: 0.166329 Oct 23 00:22:30.073326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 582/1135] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:22:29 2022] DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments/f38f5806-d68a-44fb-a63d-fccaa397811d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:22:30.082359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:30.084532 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:30.093177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:30.094001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:30.094454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:30.095164 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:30.095816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:30.096256 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:30.130379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f8fa43c8-f817-4d4a-88dc-c5076ef3807d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051983 Oct 23 00:22:30.130926 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 554/1136] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:22:30 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:22:31.144472 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:31.146867 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:31.153210 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.153695 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.154130 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.155493 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.155943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.156367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.187731 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-796763d0-271e-4c6e-a156-7728dc2b6911 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048569 Oct 23 00:22:31.188290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 583/1137] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:22:31 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 00:22:31.253280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:31.253786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:31.260159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.260676 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.261111 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.261787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.262233 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.262654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.289029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:22:31.364631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cd229dd0-9ffe-4c1e-9402-c76a8d8a0dde tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 204 len: 0 microversion: 2.1 time: 0.114584 Oct 23 00:22:31.365524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 555/1138] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:22:31 2022] DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:22:31.375065 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:31.375677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:31.381685 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.382155 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.382584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.383260 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:31.383707 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:31.384126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:31.514503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:31.522236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a8d9b5cb-008e-4992-a61f-68394de79d4c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1679 microversion: 2.1 time: 0.152158 Oct 23 00:22:31.522803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 584/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:31 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:32.547179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:32.547791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:32.554182 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:32.554658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:32.555087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:32.555779 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:32.556227 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:32.556674 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:32.686584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:32.694203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9ab1dacd-d245-4979-b1ee-8fa547c595db tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1679 microversion: 2.1 time: 0.152069 Oct 23 00:22:32.694762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 556/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:32 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:33.719293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:33.719987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:33.726568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:33.727040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:33.727469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:33.728160 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:33.728644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:33.729061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:33.796543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:33.804298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6f98b49d-6151-4892-bccd-55033cdc6ea8 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 200 len: 1612 microversion: 2.1 time: 0.089704 Oct 23 00:22:33.804898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 585/1141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:33 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:34.054123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa38ebe-250a-4b15-ab03-629f7278d6cd", "name": "network-vif-deleted", "tag": "3c3602f1-3e7e-4141-8b02-5e981db529ce"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:34.065041 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:34.065533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:34.065960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:34.079790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] Creating event network-vif-deleted:3c3602f1-3e7e-4141-8b02-5e981db529ce for instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd on hv-cinder-86156 Oct 23 00:22:34.086527 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-56a735d4-ad92-4594-9d8e-aa24eb5a8447 req-47845a51-9334-4e8b-be16-03a56ddd7e05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036113 Oct 23 00:22:34.087221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 557/1142] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:34.829114 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:34.830113 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:34.837500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:34.838091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:34.838531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:34.839246 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:34.839851 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:34.840315 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:34.855151 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd HTTP/1.1 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:22:34.856882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:22:34.859161 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '7aa38ebe-250a-4b15-ab03-629f7278d6cd'} Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:22:34.860226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:22:34.861847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:22:34.863355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:22:34.863355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0dad3a74-3d94-42fd-ab69-8fd3ff3ade6e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 404 len: 111 microversion: 2.1 time: 0.035203 Oct 23 00:22:34.863355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 586/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:34 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:22:34.868479 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0a1621ec-bfb7-4442-8205-54bb8cc57b96 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '.version_select at 0x7f3f8d9bd8b0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:34.888438 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0a1621ec-bfb7-4442-8205-54bb8cc57b96 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724586078" status: 202 len: 0 microversion: 2.1 time: 0.024239 Oct 23 00:22:34.889562 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 558/1144] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 00:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724586078 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:22:35.503889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1e201ae3-ac42-4896-bca3-5927be0fc5ea tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: .version_select at 0x7f3f8d8d2dc0>, body: {"keypair": {"name": "tempest-keypair-1951581686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6TxdBN3MucLq2O48pT45b8OG5Q3STnyyDXdgJR7db8iSOH5qMqZpnb4DGfbbmw/MEj9YK7XU/AbZOnNoLF12l81I7vM0XHDGgm6fmUWXzSCtuVc+i4oL570p3APafmVg=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:35.519170 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-1e201ae3-ac42-4896-bca3-5927be0fc5ea tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:22:35.522923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-1e201ae3-ac42-4896-bca3-5927be0fc5ea tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:22:35.544616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1e201ae3-ac42-4896-bca3-5927be0fc5ea tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044503 Oct 23 00:22:35.545909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 587/1145] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:22:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:36.742195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-200895059", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4edcd026-bef0-4b4d-831f-46b273b092a5"}], "security_groups": [{"name": "tempest-securitygroup--1742560556"}], "key_name": "tempest-keypair-1951581686", "user_data": "}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:36.845350 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] validate_networks() for [('4edcd026-bef0-4b4d-831f-46b273b092a5', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:22:37.207838 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:22:37.208264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:22:37.208808 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:22:37.209222 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:22:37.209638 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:22:37.218894 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:37.219367 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:37.219801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:37.220548 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:37.221004 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:37.221434 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:37.237689 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:22:37.241625 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Getting quotas for user 06e2b7a78a174a5a82493f58add77988 and project 1915ae97801b493fb42f8479cafd9d87. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:22:37.252775 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:22:37.255115 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:22:37.302717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e50e8de3-be6e-4a73-a433-92a1722fba68 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565363 Oct 23 00:22:37.303359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 559/1146] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:22:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:22:37.315135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-40e779d0-4b83-4e9c-9e33-cac96b58bfd0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:37.315754 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-40e779d0-4b83-4e9c-9e33-cac96b58bfd0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:37.372187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-40e779d0-4b83-4e9c-9e33-cac96b58bfd0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:37.379380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-40e779d0-4b83-4e9c-9e33-cac96b58bfd0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1241 microversion: 2.1 time: 0.068704 Oct 23 00:22:37.380040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 588/1147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:37 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:38.402242 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:38.402852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:38.409543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:38.410023 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:38.410455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:38.411134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:38.411581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:38.411998 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:38.479228 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:38.489213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-76d2e697-2925-4a55-8de0-2bd10b875512 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1299 microversion: 2.1 time: 0.091175 Oct 23 00:22:38.489791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 560/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:38 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:39.512888 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:39.513503 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:39.519568 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:39.520041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:39.520470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:39.521173 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:39.521623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:39.522044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:39.649691 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215ab60f-d1aa-4b05-a914-64e0daa5cec0", "tag": "c5b191b5-90ec-43c9-86ff-91076dd0904d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:39.661153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:39.662972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:39.664237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:39.665179 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:39.678027 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] Creating event network-changed:c5b191b5-90ec-43c9-86ff-91076dd0904d for instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 on hv-cinder-86156 Oct 23 00:22:39.683600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-f0ef62bd-9dc6-43eb-99e0-fa7ce6e3e415 req-f493eb2c-b6a6-44fc-a0dd-c25b31aab4b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036937 Oct 23 00:22:39.684459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 561/1149] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:22:39.686455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-57af6905-befa-41b5-8fdc-ef83172742c3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.176745 Oct 23 00:22:39.696753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 589/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:39 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:40.710384 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:40.711116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:40.717364 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:40.717853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:40.718289 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:40.718980 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:40.719439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:40.719868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:40.848978 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:40.856538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d847497c-c786-48b2-bae3-f3b114abddcf tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.150831 Oct 23 00:22:40.857101 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 562/1151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:40 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:22:41.880521 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:41.881144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:41.887601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:41.888080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:41.888538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:41.889288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:41.889739 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:41.890159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:42.018368 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:42.025908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-68ed4c81-07fe-4f5d-93fc-95b020f5205b tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.149371 Oct 23 00:22:42.026502 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 590/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:41 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:43.048614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:43.049264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:43.055661 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:43.056142 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:43.056605 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:43.057294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:43.057750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:43.058175 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:43.188694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:43.196251 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c0374e02-96c8-4e24-8804-350e94a49bc3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.151501 Oct 23 00:22:43.196839 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 563/1153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:43 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:44.219744 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:44.220348 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:44.226779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:44.227251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:44.227679 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:44.228355 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:44.228829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:44.229245 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:44.356091 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:44.363850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-352f5b8a-88ed-40e6-8bdf-26bf9672a944 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.148617 Oct 23 00:22:44.364364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 591/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:44 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:45.386869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:45.387420 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:45.394452 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:45.394935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:45.395371 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:45.396067 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:45.396538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:45.396962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:45.429273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215ab60f-d1aa-4b05-a914-64e0daa5cec0", "name": "network-vif-plugged", "status": "completed", "tag": "c5b191b5-90ec-43c9-86ff-91076dd0904d"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:45.441029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:45.441494 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:45.441923 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:45.460238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] Creating event network-vif-plugged:c5b191b5-90ec-43c9-86ff-91076dd0904d for instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 on hv-cinder-86156 Oct 23 00:22:45.465760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-07c37811-05b2-402b-9726-f97d473c84f4 req-98a60d82-ca77-4715-aac4-0ee858645f69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040127 Oct 23 00:22:45.466908 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 592/1155] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:22:45.549976 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:45.558809 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-927400d2-a2c2-4bf5-b13d-9055c68888a0 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.175912 Oct 23 00:22:45.559388 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 564/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:45 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:46.582860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:46.583476 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:46.589996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:46.590469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:46.590899 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:46.591571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:46.592646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:46.593067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:46.722545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:46.730145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-12256a0e-95ba-4012-934c-edc8ae64aa59 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1367 microversion: 2.1 time: 0.151547 Oct 23 00:22:46.730718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 593/1157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:46 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:47.754502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:47.755045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:47.757197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:47.757927 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:47.764083 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:47.764551 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:47.764992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:47.765682 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:47.766141 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:47.766565 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:47.893139 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:22:47.900780 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-49f6d6ab-0467-4866-a918-0d3983d0bc7d tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1556 microversion: 2.1 time: 0.150177 Oct 23 00:22:47.901345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 565/1158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:22:47 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:22:47.923613 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:22:47.924126 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:22:47.926051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:22:47.931644 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:47.932121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:47.932579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:47.933268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:47.933718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:47.934145 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:48.014486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1e8eee54-2346-4775-90e2-5768ad1cbafe tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095167 Oct 23 00:22:48.015067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 594/1159] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 00:22:47 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:22:49.155732 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215ab60f-d1aa-4b05-a914-64e0daa5cec0", "tag": "c5b191b5-90ec-43c9-86ff-91076dd0904d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:22:49.165470 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:22:49.165946 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:22:49.166380 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:22:49.177880 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] Creating event network-changed:c5b191b5-90ec-43c9-86ff-91076dd0904d for instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 on hv-cinder-86156 Oct 23 00:22:49.182864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-290f10e5-f004-42f8-a199-63379d278e10 req-d22ff7ec-b9a5-4766-b9ad-e20d092516c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030990 Oct 23 00:22:49.183454 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 566/1160] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:01.805534 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:01.806354 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:01.811033 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:01.811520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:01.821845 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:01.822320 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:01.822750 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:01.823427 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:01.823873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:01.824290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:01.849299 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1aeb3b08-1296-4876-a767-e7596b023932 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/ips" status: 200 len: 149 microversion: 2.1 time: 0.045616 Oct 23 00:24:01.849872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 595/1161] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:24:01 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:03.186135 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:03.186886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:03.192116 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "143fe301-8627-49d6-8ff5-667803468807"}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:03.194543 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:03.202216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:03.202719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:03.203155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:03.203844 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:03.204306 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:03.204751 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:03.536703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-89bd952c-4e52-4def-aa81-bb1713157b89 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "POST /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352499 Oct 23 00:24:03.537318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 567/1162] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 00:24:03 2022] POST /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:11.182376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:11.182882 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:11.190040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:11.190522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:11.191571 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:11.192273 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:11.192760 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:11.193193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:11.327630 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lazy-loading 'services' on Instance uuid 215ab60f-d1aa-4b05-a914-64e0daa5cec0 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:24:11.400251 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f0c05c64-03b6-4c25-8330-f2fe196f3e7c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments/143fe301-8627-49d6-8ff5-667803468807" status: 202 len: 0 microversion: 2.1 time: 0.221638 Oct 23 00:24:11.400873 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 596/1163] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 00:24:11 2022] DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments/143fe301-8627-49d6-8ff5-667803468807 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:24:11.411119 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:11.413555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:11.420728 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:11.421361 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:11.421816 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:11.422522 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:11.423012 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:11.423414 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:11.457200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-da3f4a76-4267-4299-8bed-b306c25c30d3 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Oct 23 00:24:11.457680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 568/1164] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:24:11 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:12.470710 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:12.472964 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:12.479913 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.480393 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.480853 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.481538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.481989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.482414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.511799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-a9039415-e3b7-4177-a1c8-03a97ce61c30 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046202 Oct 23 00:24:12.512352 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 597/1165] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 00:24:12 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 00:24:12.576853 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:12.577366 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:12.584214 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.584716 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.585151 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.585835 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.586286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.586708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.611573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:24:12.686725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4d887c2a-3b7a-4af7-a70e-adfde3c98d4f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 204 len: 0 microversion: 2.1 time: 0.113265 Oct 23 00:24:12.687558 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 569/1166] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:12 2022] DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:24:12.696665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:12.697276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:12.703105 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.703850 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.704276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.705002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:12.705448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:12.705868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:12.837372 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:12.845156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-379d8b91-a947-4745-9aec-2c47787f0e76 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1681 microversion: 2.1 time: 0.153155 Oct 23 00:24:12.845721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 598/1167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:12 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:13.869663 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:13.870324 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:13.877093 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:13.877569 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:13.878003 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:13.878688 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:13.879131 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:13.879549 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:14.012249 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:14.019949 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-081cd15f-7592-4888-97b3-f5e8354fc3f6 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1681 microversion: 2.1 time: 0.154722 Oct 23 00:24:14.021052 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 570/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:13 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:15.045216 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:15.045829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:15.053376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:15.053865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:15.054294 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:15.054978 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:15.055428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:15.055847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:15.189505 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e2b7a78a174a5a82493f58add77988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1915ae97801b493fb42f8479cafd9d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:15.197868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b463e9cf-d6c6-439c-a332-5008c45c7b9e tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 200 len: 1681 microversion: 2.1 time: 0.156420 Oct 23 00:24:15.198447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 599/1169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:15 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:15.695703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215ab60f-d1aa-4b05-a914-64e0daa5cec0", "name": "network-vif-deleted", "tag": "c5b191b5-90ec-43c9-86ff-91076dd0904d"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:15.705647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:15.706134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:15.706573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:15.721523 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] Creating event network-vif-deleted:c5b191b5-90ec-43c9-86ff-91076dd0904d for instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 on hv-cinder-86156 Oct 23 00:24:15.728200 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-baa906de-165c-4ecc-a0ba-46c3849fd5b8 req-b26c81f1-85a2-4344-a224-9f0297b912f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098093 Oct 23 00:24:15.732192 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 571/1170] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:16.222176 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:16.222805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:16.230601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:16.231227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:16.231670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:16.232376 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:16.232862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:16.233290 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:16.249486 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 HTTP/1.1 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:16.251159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:16.253000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '215ab60f-d1aa-4b05-a914-64e0daa5cec0'} Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:16.253859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:16.255520 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:16.257164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:16.257164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-27707f06-c5db-47d3-aec8-b0aaab6a9f25 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 404 len: 111 microversion: 2.1 time: 0.034533 Oct 23 00:24:16.257164 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 600/1171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:16 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:16.262318 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-78078d3b-39a6-4c5c-b81a-44e6d7bef20c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '.version_select at 0x7f3f8d88c790>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:16.282499 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-78078d3b-39a6-4c5c-b81a-44e6d7bef20c tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951581686" status: 202 len: 0 microversion: 2.1 time: 0.024384 Oct 23 00:24:16.283088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 572/1172] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 00:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951581686 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 00:24:18.032510 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:18.033028 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:18.039856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:18.040327 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:18.040859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:18.041543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:18.041990 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:18.042408 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:18.056219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 HTTP/1.1 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:18.057752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.059484 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '215ab60f-d1aa-4b05-a914-64e0daa5cec0'} Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:18.060439 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.062071 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.063878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:18.063878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-314f511e-82ed-4832-befd-6112dfc28cdb tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 404 len: 111 microversion: 2.1 time: 0.030469 Oct 23 00:24:18.063878 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 601/1173] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:18 2022] DELETE /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:18.067352 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:18.068078 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 215ab60f-d1aa-4b05-a914-64e0daa5cec0] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:18.075026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:18.075502 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:18.075931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:18.076642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:18.077107 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:18.077509 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:18.090510 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 HTTP/1.1 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:18.092174 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.093948 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '215ab60f-d1aa-4b05-a914-64e0daa5cec0'} Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:18.094791 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. Oct 23 00:24:18.096096 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:18.099813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 215ab60f-d1aa-4b05-a914-64e0daa5cec0 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:18.099813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-30b88c2f-c045-470c-92e6-6aaeb973b34f tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0" status: 404 len: 111 microversion: 2.1 time: 0.030043 Oct 23 00:24:18.099813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 573/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:18 2022] GET /compute/v2.1/servers/215ab60f-d1aa-4b05-a914-64e0daa5cec0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:19.233500 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:19.233988 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:19.240301 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.240822 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.241766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.242449 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.242898 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.243321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.257457 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd HTTP/1.1 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:19.259000 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.260684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '7aa38ebe-250a-4b15-ab03-629f7278d6cd'} Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:19.261639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.263146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.264642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:19.264642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4e8dd576-11a3-4dfa-bab5-8b9067535341 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 404 len: 111 microversion: 2.1 time: 0.030711 Oct 23 00:24:19.264642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 602/1175] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:19 2022] DELETE /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:19.268639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:19.269248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 7aa38ebe-250a-4b15-ab03-629f7278d6cd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:19.276029 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.276531 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.276965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.277645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.278090 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.278510 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.293962 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd HTTP/1.1 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:19.295458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.297203 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '7aa38ebe-250a-4b15-ab03-629f7278d6cd'} Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:19.298123 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. Oct 23 00:24:19.299656 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.301553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 7aa38ebe-250a-4b15-ab03-629f7278d6cd could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:19.301553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cd41ad43-a576-417c-ada4-113d8ac976bd tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd" status: 404 len: 111 microversion: 2.1 time: 0.031989 Oct 23 00:24:19.301553 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 574/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:19 2022] GET /compute/v2.1/servers/7aa38ebe-250a-4b15-ab03-629f7278d6cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:19.305700 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:19.306203 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:19.312064 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.312577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.313017 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.313702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.314159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.314582 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.327720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c HTTP/1.1 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:19.329276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.330943 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '3968a159-b75e-495a-a029-f3508332ca6c'} Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:19.331801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.333364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.334886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:19.334886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-6959410f-8a4a-4f97-b996-1fb57c08cfb1 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 404 len: 111 microversion: 2.1 time: 0.029379 Oct 23 00:24:19.334886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 603/1177] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:19 2022] DELETE /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:19.339402 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:19.340010 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: 3968a159-b75e-495a-a029-f3508332ca6c] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:19.345813 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.346287 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.346718 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.347394 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:19.347842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:19.348262 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:19.362563 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c HTTP/1.1 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:19.363990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.365641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '3968a159-b75e-495a-a029-f3508332ca6c'} Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:19.367058 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. Oct 23 00:24:19.368555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:19.369889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance 3968a159-b75e-495a-a029-f3508332ca6c could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:19.369889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2bf1baf4-305b-4793-a198-c08b6ea2bb99 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c" status: 404 len: 111 microversion: 2.1 time: 0.030298 Oct 23 00:24:19.369889 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 575/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:19 2022] GET /compute/v2.1/servers/3968a159-b75e-495a-a029-f3508332ca6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:20.504991 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:20.505493 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:20.512584 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:20.513067 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:20.513504 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:20.514193 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:20.514647 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:20.515068 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:20.528279 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 HTTP/1.1 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:20.529865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.531545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': 'df5a816e-e95d-4146-a712-5957c4566c67'} Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:20.532756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.534291 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.536146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:20.536146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2c11579c-1a26-4e4a-9f9d-5581226380df tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 404 len: 111 microversion: 2.1 time: 0.030138 Oct 23 00:24:20.536146 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 604/1179] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:20 2022] DELETE /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:20.540108 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:20.540772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] [instance: df5a816e-e95d-4146-a712-5957c4566c67] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:20.547033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:20.547504 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:20.547933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:20.548637 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:20.549087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:20.549507 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:20.563407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] HTTP exception thrown: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Request method failure captured: Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 HTTP/1.1 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIffUn76xvE0cpJ4KLsAxvn1sOTSkZW7FE63XkVloXlBIBQDFpBt7Ok5hmRWMqVEyYfFhXa14OkV7igiNsasuP6-mCVe0D9Ps5n-TxhqnYdcLswft6k3A-aPjHA0_9-JDHOPsZQfU7mBufkZES0NUyk58kPpopiD064hmpcjHw4-pSw Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:20.565038 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1915ae97801b493fb42f8479cafd9d87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1915ae97801b493fb42f8479cafd9d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 1915ae97801b493fb42f8479cafd9d87 Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-311203504 Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 06e2b7a78a174a5a82493f58add77988 Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-AttachVolumeNegativeTest-311203504-project Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.566673 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'df5a816e-e95d-4146-a712-5957c4566c67'} Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:20.567745 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. Oct 23 00:24:20.569294 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:20.571458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] Returning 404 to user: Instance df5a816e-e95d-4146-a712-5957c4566c67 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:20.571458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-43b34dce-7542-4717-b4d3-82c850b4c792 tempest-AttachVolumeNegativeTest-311203504 tempest-AttachVolumeNegativeTest-311203504-project] 10.222.0.13 "GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67" status: 404 len: 111 microversion: 2.1 time: 0.030648 Oct 23 00:24:20.571458 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 576/1180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:20 2022] GET /compute/v2.1/servers/df5a816e-e95d-4146-a712-5957c4566c67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 00:24:24.968329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ade7e38-288e-4479-b2c5-8fed8dd24c61 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Action: 'create', calling method: .version_select at 0x7f3f91021790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1333933010", "metadata": {"Type": "work"}}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ade7e38-288e-4479-b2c5-8fed8dd24c61 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 122 Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:24.984094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1333933010", "metadata": {"Type": "work"}}} Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:24:24.985797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1333933010', 'metadata': {'Type': 'work'}}}} Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise error Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi '#$%' Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:24.986881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 00:24:24.988285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 00:24:24.989563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 00:24:24.989563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:24.989563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ade7e38-288e-4479-b2c5-8fed8dd24c61 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:24.989563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7ade7e38-288e-4479-b2c5-8fed8dd24c61 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129733 Oct 23 00:24:24.989563 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 605/1181] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 00:24:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:24:24.995607 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-316fb729-a3a4-4487-a6da-7a58d168eaf3 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Action: 'create', calling method: .version_select at 0x7f3f8d8c2e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-317679202", "metadata": {"Type": "work"}}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-316fb729-a3a4-4487-a6da-7a58d168eaf3 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 119 Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:25.000313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-317679202", "metadata": {"Type": "work"}}} Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: Oct 23 00:24:25.002062 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-317679202', 'metadata': {'Type': 'work'}}}} Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise error Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi '0' Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:25.003154 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 00:24:25.004753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 00:24:25.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 00:24:25.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-316fb729-a3a4-4487-a6da-7a58d168eaf3 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:25.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-316fb729-a3a4-4487-a6da-7a58d168eaf3 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010448 Oct 23 00:24:25.006018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 577/1182] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 00:24:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:24:25.011159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0afb2ad6-b123-4ff4-a4c3-70590eed3cbb tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Action: 'create', calling method: .version_select at 0x7f3f8d6893a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1697955856", "metadata": {"Type": "work"}}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0afb2ad6-b123-4ff4-a4c3-70590eed3cbb tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 119 Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:25.015861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1697955856", "metadata": {"Type": "work"}}} Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:24:25.017580 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1697955856', 'metadata': {'Type': 'work'}}}} Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise error Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi '' Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:25.018669 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 00:24:25.020254 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 00:24:25.021547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 00:24:25.021547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.021547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0afb2ad6-b123-4ff4-a4c3-70590eed3cbb tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:25.021547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0afb2ad6-b123-4ff4-a4c3-70590eed3cbb tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010503 Oct 23 00:24:25.021547 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 606/1183] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 00:24:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 00:24:25.027248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cebd59c3-8112-4dfa-917d-d3d8be036c43 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Calling method '.version_select at 0x7f3f8d96d940>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:25.058727 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-cebd59c3-8112-4dfa-917d-d3d8be036c43 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] HTTP exception thrown: Volume tempest-invalid-1563822665 could not be found. Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cebd59c3-8112-4dfa-917d-d3d8be036c43 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1563822665 HTTP/1.1 Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:25.060747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Volume tempest-invalid-1563822665 could not be found. Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'tempest-invalid-1563822665'} Oct 23 00:24:25.062353 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1563822665 could not be found. (HTTP 404) (Request-ID: req-521422ee-8044-448d-9479-db1876c84c5c) Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.063280 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:24:25.065568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1563822665 could not be found. Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:25.067018 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1563822665 could not be found. Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1563822665 could not be found. Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cebd59c3-8112-4dfa-917d-d3d8be036c43 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 404 to user: Volume tempest-invalid-1563822665 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cebd59c3-8112-4dfa-917d-d3d8be036c43 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1563822665" status: 404 len: 99 microversion: 2.1 time: 0.039258 Oct 23 00:24:25.068615 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 578/1184] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 00:24:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1563822665 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 00:24:25.072451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-80eb8146-512d-4641-bf23-2e7c60cdc9ad tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004532 Oct 23 00:24:25.072968 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 607/1185] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 23 00:24:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 00:24:25.081400 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e622e6ae-e0bb-42ec-81a5-edb355f0a251 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003678 Oct 23 00:24:25.081895 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 579/1186] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 23 00:24:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 00:24:25.089781 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f388e219-4688-4404-9e02-6bf3b0c12ae7 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Calling method '.version_select at 0x7f3f8d922280>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:25.120652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-f388e219-4688-4404-9e02-6bf3b0c12ae7 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] HTTP exception thrown: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f388e219-4688-4404-9e02-6bf3b0c12ae7 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: DELETE /compute/v2.1/os-volumes/2f39ac81-c4cf-4fab-9973-de9d53a98533 HTTP/1.1 Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:24:25.123060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '2f39ac81-c4cf-4fab-9973-de9d53a98533'} Oct 23 00:24:25.124753 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. (HTTP 404) (Request-ID: req-1355fe03-d7a8-46e7-986d-92b825c5a200) Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.125875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 00:24:25.127343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 00:24:25.128778 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f388e219-4688-4404-9e02-6bf3b0c12ae7 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 404 to user: Volume 2f39ac81-c4cf-4fab-9973-de9d53a98533 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f388e219-4688-4404-9e02-6bf3b0c12ae7 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/2f39ac81-c4cf-4fab-9973-de9d53a98533" status: 404 len: 109 microversion: 2.1 time: 0.038197 Oct 23 00:24:25.130416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 608/1187] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 00:24:25 2022] DELETE /compute/v2.1/os-volumes/2f39ac81-c4cf-4fab-9973-de9d53a98533 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:25.135216 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d80a8744-249f-47a5-9930-e8703c462e07 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Calling method '.version_select at 0x7f3f8d869c10>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:25.161766 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-d80a8744-249f-47a5-9930-e8703c462e07 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] HTTP exception thrown: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d80a8744-249f-47a5-9930-e8703c462e07 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Request method failure captured: Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/os-volumes/d62524ab-5754-47b0-87e1-b70f0383b983 HTTP/1.1 Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIm4PS64NcE2fgEmKgpI7VEpM9ycyZDHhGGNXcORvXTwVLVs8Ai32jGkJtLsbBGsWKqkjGl_ZsXqpx8mY-8RloZ7EiT6wN7mlHEHzII8Mnjv1G5wX1v4YsVG_xyuU3WHeZcZffFh7bKz7dHhXgsYifebtKxiErg_rvKP0M5qJsBwbUY Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:25.163715 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9cdb3d5d9484d749bc0c7c3fd13049e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9cdb3d5d9484d749bc0c7c3fd13049e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: a9cdb3d5d9484d749bc0c7c3fd13049e Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesNegativeTest-2052892499 Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 811ebd4a97cf411a9d71228dbaa06cc2 Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesNegativeTest-2052892499-project Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': 'd62524ab-5754-47b0-87e1-b70f0383b983'} Oct 23 00:24:25.165237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. (HTTP 404) (Request-ID: req-9cff3cb0-7299-4d7f-a85c-c2faced1471f) Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.166071 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 00:24:25.167270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 00:24:25.169106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d80a8744-249f-47a5-9930-e8703c462e07 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] Returning 404 to user: Volume d62524ab-5754-47b0-87e1-b70f0383b983 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d80a8744-249f-47a5-9930-e8703c462e07 tempest-VolumesNegativeTest-2052892499 tempest-VolumesNegativeTest-2052892499-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d62524ab-5754-47b0-87e1-b70f0383b983" status: 404 len: 109 microversion: 2.1 time: 0.034425 Oct 23 00:24:25.170707 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 580/1188] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 00:24:25 2022] GET /compute/v2.1/os-volumes/d62524ab-5754-47b0-87e1-b70f0383b983 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:24:38.558187 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=20 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:38.558932 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:38.564264 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-532331398", "imageRef": "4a5b32fb-b1f8-40f6-b55e-2d4508838bc5", "flavorRef": "452"}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:38.617709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] validate_networks() for None {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:24:38.888717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:24:38.889137 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:24:38.889608 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:24:38.890009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:24:38.890414 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:24:38.899686 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:38.900157 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:38.900639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:38.901358 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:38.901805 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:38.902221 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:38.919974 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Getting quotas for project bdc9747f00794db98384c7a51d2d98e1. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:24:38.923907 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Getting quotas for user c380b0ec2d52401e8dc89f957ece313f and project bdc9747f00794db98384c7a51d2d98e1. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:24:38.935293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:24:38.937567 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a5b32fb-b1f8-40f6-b55e-2d4508838bc5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:24:38.983841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8d213d12-03c0-444d-8d42-40b29e5baa48 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426818 Oct 23 00:24:38.984361 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 609/1189] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:24:38.993671 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:38.994593 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:38.999762 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-17f15e1f-8494-473b-ac15-5d3a2b032211 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:39.000379 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-17f15e1f-8494-473b-ac15-5d3a2b032211 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:39.057491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-17f15e1f-8494-473b-ac15-5d3a2b032211 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:39.064467 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-17f15e1f-8494-473b-ac15-5d3a2b032211 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1214 microversion: 2.1 time: 0.072938 Oct 23 00:24:39.072573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 581/1190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:38 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:40.089110 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:40.090023 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:40.109820 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:40.110416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:40.111087 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:40.111784 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:40.112933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:40.112933 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:40.178604 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:40.186506 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-1bf029dc-34bd-44a4-b60a-e3bbe6837691 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1272 microversion: 2.1 time: 0.102475 Oct 23 00:24:40.187078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 610/1191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:40 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:41.209506 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:41.210253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:41.216786 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:41.217274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:41.217708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:41.218401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:41.218856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:41.219283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:41.350160 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:41.358709 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-03f5fc78-177e-4e5c-a07a-865b159e9fa1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.153069 Oct 23 00:24:41.359278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 582/1192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:41 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:41.566219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6ed9da-cab7-4ee4-a7a7-917485cba008", "tag": "c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:41.577725 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:41.578202 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:41.578635 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:41.590123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] Creating event network-changed:c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4 for instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 on hv-cinder-86156 Oct 23 00:24:41.595043 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-16221a03-7099-4ecb-b2b9-b38f70d945b6 req-4716f23d-e9f9-43c5-908c-446989143215 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032604 Oct 23 00:24:41.595633 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 611/1193] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:24:42.382825 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:42.383589 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:42.389876 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:42.390355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:42.390795 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:42.391486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:42.391965 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:42.392397 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:42.522659 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:42.530924 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b3a870ea-2612-4d22-8f99-3acbf85f6e4a tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.151962 Oct 23 00:24:42.531614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 583/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:42 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:43.554653 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:43.555321 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:43.562060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:43.562540 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:43.562969 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:43.563648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:43.564099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:43.564537 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:43.692228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:43.699907 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d73166a2-0053-4a9b-9dc9-896f1f4378cd tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.149976 Oct 23 00:24:43.700475 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 612/1195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:43 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:44.723292 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:44.723814 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:44.731260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:44.731741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:44.732177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:44.732899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:44.733356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:44.733783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:44.859918 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:44.867500 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-68e0c29c-49ee-4287-a8c4-85a26833b132 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.148119 Oct 23 00:24:44.869089 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 584/1196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:44 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:24:45.891610 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:45.892205 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:45.898602 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:45.899349 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:45.899818 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:45.900538 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:45.901001 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:45.901428 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:46.034381 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:46.043021 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-08df8131-67ee-4b67-b4d3-52849579eeee tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.155613 Oct 23 00:24:46.043597 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 613/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:45 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:46.102641 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6ed9da-cab7-4ee4-a7a7-917485cba008", "name": "network-vif-plugged", "status": "completed", "tag": "c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:46.113482 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:46.114117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:46.114413 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:46.126148 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] Creating event network-vif-plugged:c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4 for instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 on hv-cinder-86156 Oct 23 00:24:46.131046 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-543e37d1-65f2-4c15-92d3-35ded430d9a3 req-346c31ea-4a77-41c0-840c-408342c36942 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Oct 23 00:24:46.131654 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 585/1198] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:47.066619 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:47.067208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:47.074240 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:47.074718 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:47.075156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:47.075835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:47.076283 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:47.076729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:47.203514 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:47.211149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-73ef0e81-6ede-4542-b370-1b21393d7676 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1314 microversion: 2.1 time: 0.148461 Oct 23 00:24:47.212236 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 614/1199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:47 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:24:48.235313 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:48.236015 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:48.242239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.243372 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.243789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.244599 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.245063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.245491 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.377852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:48.386525 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-02abbe4b-775d-4685-82ed-66c4f4086e52 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1462 microversion: 2.1 time: 0.155895 Oct 23 00:24:48.387130 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 586/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:48 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:24:48.432158 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:48.432675 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:48.439300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.439774 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.440200 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.440971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.441416 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.441835 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.466729 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Going to try to terminate instance {{(pid=118855) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:24:48.541006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-64e1fed9-849c-42bc-998e-e44ff13f5072 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 204 len: 0 microversion: 2.1 time: 0.111816 Oct 23 00:24:48.541581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 615/1201] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:24:48 2022] DELETE /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:24:48.550538 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:48.551184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:48.558319 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.558801 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.559237 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.559933 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:48.560387 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:48.560863 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:48.687984 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:48.696086 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3ea9cb03-7dde-4135-afd0-91e90f8330a1 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1468 microversion: 2.1 time: 0.149017 Oct 23 00:24:48.696787 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 587/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:48 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1468 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:49.719775 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:49.720531 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:49.722447 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:49.723107 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:49.730522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:49.731006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:49.731441 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:49.732149 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:49.732632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:49.733062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:49.869607 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:49.877622 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ca3a8a62-e582-41d7-9c65-3cf4fa1118ab tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1468 microversion: 2.1 time: 0.162153 Oct 23 00:24:49.878191 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 616/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:49 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1468 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:50.460432 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6ed9da-cab7-4ee4-a7a7-917485cba008", "name": "network-vif-deleted", "tag": "c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:24:50.467704 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:24:50.472898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:50.473403 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:50.473836 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:50.485964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] Creating event network-vif-deleted:c6fa5ed4-0939-455e-a4ea-72cc4ab8b6f4 for instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 on hv-cinder-86156 Oct 23 00:24:50.490990 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-9b0db625-f4d2-445c-972b-d73aad651b95 req-027e2d75-4981-4ae5-a1de-5d80187daca7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Oct 23 00:24:50.491624 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 588/1204] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:24:50.901936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:50.902555 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:50.909167 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:50.909654 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:50.910084 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:50.910779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:50.911238 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:50.911673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:50.944438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:50.944955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:50.945420 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:50.946999 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lazy-loading 'fault' on Instance uuid 0a6ed9da-cab7-4ee4-a7a7-917485cba008 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:24:50.991979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c380b0ec2d52401e8dc89f957ece313f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc9747f00794db98384c7a51d2d98e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:24:50.999288 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b00243c4-6d09-40eb-b6c5-3e5dcfbcdaa8 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 200 len: 1304 microversion: 2.1 time: 0.102016 Oct 23 00:24:50.999847 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 617/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:50 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:24:52.023449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:24:52.024616 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] [instance: 0a6ed9da-cab7-4ee4-a7a7-917485cba008] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:24:52.030702 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:52.031178 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:52.031604 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:52.032283 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:24:52.032757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:24:52.033176 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:24:52.046568 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] HTTP exception thrown: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Request method failure captured: Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 HTTP/1.1 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVInEtHjG3qgdjxRdsai_u7mY7rlwbudI6n7qDkk6-ob08fLZeYhqhlgsGFrctPdCcX4-60GFx4T9u5hweN1sWZQ-ZAfvupRY5MMlNGgNkKsT599uEULV8XX6YteSRjrGgRFbVwY4WXWIiNkq9ZgeeSH-7qXgUv-yYktcLI0G8G6RFw8 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: bdc9747f00794db98384c7a51d2d98e1 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-VolumesNegativeTest-1371213893 Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:24:52.048165 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bdc9747f00794db98384c7a51d2d98e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bdc9747f00794db98384c7a51d2d98e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bdc9747f00794db98384c7a51d2d98e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bdc9747f00794db98384c7a51d2d98e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-VolumesNegativeTest-1371213893 Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: bdc9747f00794db98384c7a51d2d98e1 Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-VolumesNegativeTest-1371213893 Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-VolumesNegativeTest-1371213893-project Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: c380b0ec2d52401e8dc89f957ece313f Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-VolumesNegativeTest-1371213893-project Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. Oct 23 00:24:52.050075 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '0a6ed9da-cab7-4ee4-a7a7-917485cba008'} Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:24:52.051149 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. Oct 23 00:24:52.052966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:24:52.054635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] Returning 404 to user: Instance 0a6ed9da-cab7-4ee4-a7a7-917485cba008 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:24:52.054635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-30036fe9-fb7c-4108-bfbc-638dff6a7b10 tempest-VolumesNegativeTest-1371213893 tempest-VolumesNegativeTest-1371213893-project] 10.222.0.13 "GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008" status: 404 len: 111 microversion: 2.1 time: 0.030889 Oct 23 00:24:52.054635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 589/1206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:24:52 2022] GET /compute/v2.1/servers/0a6ed9da-cab7-4ee4-a7a7-917485cba008 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:25:06.631605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:06.633235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:06.806345 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Action: 'create', calling method: .version_select at 0x7f3f8d8d2dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1780540565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWt8LZaeQsxAk5EK9BGhX2ZJ5vf1xfdm20sSY/zcl43aI4HY6ddXyFqyV9lh9gCFhyn3KDLZG67ELkO4arc1C4gKQ7UnAxhBnYuJTrA6PmqcK/RoukmcjxlSDLPMO76Qg=="}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:25:06.822325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:25:06.826618 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for user 163f3d7a305f4d8b8eb14794a51acda4 and project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'key_pairs'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:25:06.840637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [f823f5f6-cc92-4b79-a071-0b4fc3027a9f] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 00:25:07.848989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [f823f5f6-cc92-4b79-a071-0b4fc3027a9f] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33842. Oct 23 00:25:07.864543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f863bd16-6729-482f-9253-3db5f7cf7fe4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.237778 Oct 23 00:25:07.865153 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 618/1207] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 00:25:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:25:30.488666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-582326249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780540565", "security_groups": [{"name": "tempest-secgroup-smoke-1263401825"}], "block_device_mapping_v2": [{"uuid": "d64ccfbd-d4c6-420d-8664-cbdc998a8ae8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde9904c-121b-4d23-a88a-fba69ead19b2"}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:25:30.500172 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=20 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:30.500854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=36 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:30.605999 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] validate_networks() for [('cde9904c-121b-4d23-a88a-fba69ead19b2', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:25:30.973560 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:25:30.973985 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:25:30.974460 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:25:30.974869 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:25:30.975282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:25:30.984070 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:30.984579 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:30.985019 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:30.985743 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:30.986197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:30.986622 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:31.004211 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:25:31.008155 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for user 163f3d7a305f4d8b8eb14794a51acda4 and project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:25:31.063851 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:25:31.066081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d64ccfbd-d4c6-420d-8664-cbdc998a8ae8',volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:25:31.192037 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [0bdafc7f-3e9a-4ba7-a1ef-59eb0ee57ede] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 00:25:32.200036 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [0bdafc7f-3e9a-4ba7-a1ef-59eb0ee57ede] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33980. Oct 23 00:25:32.204708 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ffdda959-e04b-4bdd-907c-fc15e652629f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.720155 Oct 23 00:25:32.205581 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 590/1208] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:25:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:25:32.214094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=4 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:32.215204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:32.219815 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-086d7942-50f5-4725-8afe-1f59f81ddea7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:32.220431 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-086d7942-50f5-4725-8afe-1f59f81ddea7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:32.278626 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-086d7942-50f5-4725-8afe-1f59f81ddea7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:32.286123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-086d7942-50f5-4725-8afe-1f59f81ddea7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1094 microversion: 2.1 time: 0.073458 Oct 23 00:25:32.286907 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 619/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:32 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:25:33.309826 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:33.311264 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:33.318229 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:33.320265 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:33.320930 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:33.321833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:33.322459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:33.323055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:33.387487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:33.395566 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d8c6dd0f-c4fd-493c-8b96-25477cc330cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1210 microversion: 2.1 time: 0.090703 Oct 23 00:25:33.396204 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 591/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:33 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:34.418918 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:34.419708 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:34.426270 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:34.426756 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:34.427197 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:34.427896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:34.428346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:34.428799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:34.562016 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968e3fb4-17cf-4214-acea-bd0036628e71", "tag": "ed975ef7-d86b-4e14-87f5-52f7e10be30a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:25:34.563697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:34.573392 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3ce352b9-827f-40d9-ba6b-ccf85dacb7a5 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.158257 Oct 23 00:25:34.574779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 620/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:34 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:34.577156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:34.577710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:34.578378 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:34.589823 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] Creating event network-changed:ed975ef7-d86b-4e14-87f5-52f7e10be30a for instance 968e3fb4-17cf-4214-acea-bd0036628e71 on hv-cinder-86156 Oct 23 00:25:34.595492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-ab4ab41b-4665-4afc-95fe-c314c114c074 req-bafd67d7-10af-4142-9aad-1e3edd7df15d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040636 Oct 23 00:25:34.596104 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 592/1212] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:25:35.597029 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:35.597666 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:35.604206 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:35.604726 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:35.605159 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:35.605843 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:35.606293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:35.606713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:35.740623 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:35.749526 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-9e3c71e5-a20e-4f36-8bfa-ffc561cb4e47 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.155886 Oct 23 00:25:35.750098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 621/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:35 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:36.773576 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:36.774274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:36.780815 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:36.781296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:36.781729 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:36.782406 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:36.782858 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:36.783282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:36.913520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:36.921291 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-fe08d212-c2bd-4719-ab63-c5958fe807e4 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.152402 Oct 23 00:25:36.921861 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 593/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:36 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:37.944519 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:37.945040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:37.951971 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:37.952451 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:37.952909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:37.953591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:37.954042 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:37.954462 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:38.090224 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:38.098507 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0c61ea19-fbef-41d2-9512-0cf9edd2e9b1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.157981 Oct 23 00:25:38.099094 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 622/1215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:37 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:39.121356 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:39.121966 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:39.129007 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:39.129480 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:39.129909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:39.130588 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:39.131034 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:39.131453 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:39.261177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:39.268928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-aa35e83b-3441-4895-8719-a7add0f7bfd7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.151410 Oct 23 00:25:39.269497 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 594/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:39 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:40.291530 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:40.292120 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:40.299036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:40.299512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:40.299944 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:40.300655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:40.301101 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:40.301517 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:40.432374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:40.440581 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f420a973-8873-430a-926c-3d4f5e07ad5c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.152864 Oct 23 00:25:40.441143 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 623/1217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:40 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:41.463409 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:41.463935 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:41.466362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:41.467073 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:41.473274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:41.473764 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:41.474197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:41.474888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:41.475342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:41.475768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:41.614524 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:41.622167 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-41caafb0-6106-4569-891f-7ee909c77180 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.162669 Oct 23 00:25:41.623281 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 595/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:41 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:25:42.645673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:42.646208 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:42.648570 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:25:42.653803 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:42.654434 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:42.655062 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:42.655769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:42.656225 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:42.656677 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:42.788015 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:42.795672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-3d6ecd83-533b-4845-a09d-d2e52b7e5370 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.153953 Oct 23 00:25:42.796231 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 624/1219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:42 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:25:43.818546 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:43.819103 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:43.825883 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:43.826614 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:43.826902 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:43.827576 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:43.828043 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:43.828459 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:43.964520 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:43.972772 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-d2497eb5-8996-4c54-836d-fff50785440c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.158072 Oct 23 00:25:43.973329 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 596/1220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:43 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:44.317002 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968e3fb4-17cf-4214-acea-bd0036628e71", "name": "network-vif-plugged", "status": "completed", "tag": "ed975ef7-d86b-4e14-87f5-52f7e10be30a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:25:44.327766 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:44.328235 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:44.328712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:44.339975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] Creating event network-vif-plugged:ed975ef7-d86b-4e14-87f5-52f7e10be30a for instance 968e3fb4-17cf-4214-acea-bd0036628e71 on hv-cinder-86156 Oct 23 00:25:44.345536 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-a804f15b-21b6-4402-83d2-0eb2217eb805 req-f484af3e-8208-4ce8-9864-9890ab945f1a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Oct 23 00:25:44.346135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 625/1221] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:25:44.995248 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:44.995855 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:45.003221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:45.003702 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:45.004134 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:45.004842 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:45.005295 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:45.005717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:45.133812 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:45.141448 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4a759e66-2b0d-4196-b4cc-19ca2dbce159 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1266 microversion: 2.1 time: 0.150138 Oct 23 00:25:45.142006 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 597/1222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:44 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:46.168855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:46.169560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:46.176360 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:46.176877 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:46.177313 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:46.178058 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:46.178509 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:46.179379 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:46.315300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:46.323052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0f478ebf-cb78-4898-a77d-f8565c472c2b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1454 microversion: 2.1 time: 0.159635 Oct 23 00:25:46.323605 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 626/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:46 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:46.346439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:25:46.347045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:25:46.353309 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:46.353783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:46.354213 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:46.354888 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:46.355333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:46.355753 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:46.485628 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:25:46.493270 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-4230c36a-f826-452c-ac39-9daff5d6be01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1454 microversion: 2.1 time: 0.150695 Oct 23 00:25:46.493829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 598/1224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:25:46 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:25:48.400632 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968e3fb4-17cf-4214-acea-bd0036628e71", "tag": "ed975ef7-d86b-4e14-87f5-52f7e10be30a"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:25:48.411117 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:25:48.411714 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:25:48.412284 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:25:48.424031 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] Creating event network-changed:ed975ef7-d86b-4e14-87f5-52f7e10be30a for instance 968e3fb4-17cf-4214-acea-bd0036628e71 on hv-cinder-86156 Oct 23 00:25:48.428970 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-a2ce6c19-68cd-4eeb-9610-25ac9814cdf4 req-e9a5da37-b022-4251-b9a5-6d5154949a8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Oct 23 00:25:48.429761 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 627/1225] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:28:02.226619 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 00:28:02.227184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Sun Oct 23 00:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 (ip 10.222.0.13) !!! Oct 23 00:28:02.227781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:02.228590 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=46 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:02.229752 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 23 00:28:02.230667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 23 00:28:02.234804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:02.235307 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:02.246929 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:02.247416 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:02.247852 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:02.248584 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:02.249042 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:02.249471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:02.274964 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:28:02.351026 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-aadb04ed-17ad-467d-ab79-f77398c4a1b6 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 204 len: 0 microversion: 2.1 time: 0.126364 Oct 23 00:28:02.351645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 599/1226] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:28:02 2022] DELETE /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:28:02.359670 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 00:28:02.360363 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 (ip 10.222.0.13) !!! Oct 23 00:28:02.361907 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=20 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:02.362645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=40 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:02.367316 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:02.368008 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:02.378648 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:02.379128 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:02.379557 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:02.380244 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:02.380717 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:02.381304 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:02.513343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:02.521051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2b268fe1-5e97-4ad8-b392-04393973c05b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1578 microversion: 2.1 time: 0.164511 Oct 23 00:28:02.521616 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 628/1227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:02 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:03.545555 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:03.546184 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:03.552759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:03.553268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:03.553817 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:03.554515 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:03.554976 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:03.555398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:03.695658 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:03.703521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b70a0b70-1ee8-407b-a510-4b0db94222fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1578 microversion: 2.1 time: 0.162327 Oct 23 00:28:03.704095 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 600/1228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:03 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:04.726914 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:04.727645 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:04.734344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:04.734902 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:04.735350 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:04.736054 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:04.736515 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:04.736949 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:04.868937 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:04.876748 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-29619772-6d6f-460d-a376-fef38fd45884 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1578 microversion: 2.1 time: 0.153913 Oct 23 00:28:04.877324 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 629/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:04 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:05.195187 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968e3fb4-17cf-4214-acea-bd0036628e71", "name": "network-vif-deleted", "tag": "ed975ef7-d86b-4e14-87f5-52f7e10be30a"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:28:05.206667 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:05.207439 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:05.208087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:05.225696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] Creating event network-vif-deleted:ed975ef7-d86b-4e14-87f5-52f7e10be30a for instance 968e3fb4-17cf-4214-acea-bd0036628e71 on hv-cinder-86156 Oct 23 00:28:05.231125 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-77cd474d-07c8-421f-a492-97550b1d1808 req-0d5bb6f4-f062-4037-9c3c-c93334770945 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041381 Oct 23 00:28:05.235156 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 601/1230] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:28:05.901909 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:05.902508 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:05.908912 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:05.909400 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:05.909827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:05.910544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:05.910956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:05.911373 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:05.946044 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:05.946680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:05.947541 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:05.948056 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.objects.instance [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lazy-loading 'fault' on Instance uuid 968e3fb4-17cf-4214-acea-bd0036628e71 {{(pid=118855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:28:05.990077 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:05.997702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-ffb5692c-da8b-4751-9228-461b64cf6724 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 200 len: 1184 microversion: 2.1 time: 0.099621 Oct 23 00:28:05.998295 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 630/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:05 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:07.023583 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:07.024202 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:07.031159 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:07.031645 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:07.032081 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:07.032794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:07.033285 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:07.033710 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:07.047260 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] HTTP exception thrown: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Request method failure captured: Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 HTTP/1.1 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIndI7FknKa3b3PdeX2XAeDDuNyw2DjABfJrjysQJV7upLRtOQ6HPhDJMGWs0No54StZMcrTHC_8ICj8Ck6HcgUliXcmSycL5vEHgTb0Xy2lciLHGgjPcPBsVEN6B9PZkZwbBXRUrBgpzi34YXzUmWR_gesNFpnjgVr0bGT9DWht3y8 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:28:07.048897 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a4117126a8d4004a3878e10554b0d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 163f3d7a305f4d8b8eb14794a51acda4 Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:28:07.050686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '968e3fb4-17cf-4214-acea-bd0036628e71'} Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:28:07.051736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:28:07.053503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:28:07.055049 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Returning 404 to user: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:28:07.055049 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5a7c1c8c-df6e-4bda-b033-9c559e7ca631 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 404 len: 111 microversion: 2.1 time: 0.031500 Oct 23 00:28:07.055049 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 602/1232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:07 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:28:07.098614 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-280226789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780540565", "security_groups": [{"name": "tempest-secgroup-smoke-1263401825"}], "block_device_mapping_v2": [{"uuid": "d64ccfbd-d4c6-420d-8664-cbdc998a8ae8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde9904c-121b-4d23-a88a-fba69ead19b2"}]}} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:28:07.216799 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.network.neutron [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] validate_networks() for [('cde9904c-121b-4d23-a88a-fba69ead19b2', None, None, None, None, None)] {{(pid=118855) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:28:07.649377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:28:07.649797 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image limits 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:28:07.650268 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:28:07.650674 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image pref 0:0:0 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:28:07.651082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.virt.hardware [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:28:07.659724 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:07.660196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:07.660663 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:07.661380 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:07.661829 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:07.662250 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:07.679609 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:28:07.683518 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.quota [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for user 163f3d7a305f4d8b8eb14794a51acda4 and project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:28:07.739816 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Going to run 1 instances... {{(pid=118855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:28:07.742577 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d64ccfbd-d4c6-420d-8664-cbdc998a8ae8',volume_size=None,volume_type=None)] {{(pid=118855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:28:07.869035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7740fbca-d1d9-4836-a398-7ca44af0f1ed tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775138 Oct 23 00:28:07.869678 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 631/1233] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:28:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:28:07.880899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-2c98624c-2172-4698-ad03-454e95fc04cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:07.881550 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-2c98624c-2172-4698-ad03-454e95fc04cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:07.939346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-2c98624c-2172-4698-ad03-454e95fc04cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:07.946747 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-2c98624c-2172-4698-ad03-454e95fc04cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1094 microversion: 2.1 time: 0.069933 Oct 23 00:28:07.947314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 603/1234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:07 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:28:08.971579 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:08.972203 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:08.979156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:08.979837 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:08.980314 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:08.981057 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:08.981512 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:08.982118 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:09.047189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:09.055421 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-d7c81aea-1bac-4254-a032-5e906c0bc855 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1210 microversion: 2.1 time: 0.088979 Oct 23 00:28:09.060815 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 632/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:08 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:10.079129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:10.079736 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:10.088033 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:10.088541 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:10.088977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:10.089685 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:10.090114 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:10.090536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:10.230881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:10.238830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-9ee64812-533f-42f6-851a-a3a657e5b66b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.163502 Oct 23 00:28:10.252511 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 604/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:10 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:10.260936 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5991ee69-5845-432d-945f-204e01638abd", "tag": "44847aed-604d-471c-8c3b-0db333afaeb3"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:28:10.271078 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:10.271592 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:10.272631 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:10.285759 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] Creating event network-changed:44847aed-604d-471c-8c3b-0db333afaeb3 for instance 5991ee69-5845-432d-945f-204e01638abd on hv-cinder-86156 Oct 23 00:28:10.290769 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-327b41ce-4c96-4f36-aae2-8aac22bbd8db req-592596e5-9e44-4b25-b285-90171b9a679e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036650 Oct 23 00:28:10.291527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 633/1237] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:28:11.266332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:11.266938 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:11.274310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:11.274804 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:11.275239 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:11.275914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:11.276362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:11.276830 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:11.413162 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:11.420959 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f90397f8-70b2-4099-add0-acdbe61038f0 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.158391 Oct 23 00:28:11.421631 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 605/1238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:11 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:12.444389 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:12.444989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:12.451080 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:12.451561 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:12.451995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:12.452715 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:12.453169 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:12.453591 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:12.582196 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:12.590040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0c6d199d-e61c-4733-b6a7-71e0d9a7f26e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.151115 Oct 23 00:28:12.590600 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 634/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:12 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:13.612693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:13.613314 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:13.620046 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:13.620552 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:13.620994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:13.621680 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:13.622132 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:13.622585 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:13.757761 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:13.765425 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-1c853964-262b-43b0-b428-0fa99c2c124a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.156632 Oct 23 00:28:13.765994 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 606/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:13 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:14.789300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:14.789967 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:14.796578 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:14.797059 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:14.797498 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:14.798232 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:14.798665 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:14.799088 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:14.929300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:14.936957 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-b3ed2430-7c96-4da0-8dde-558b49d1fe8d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.151847 Oct 23 00:28:14.937524 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 635/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:14 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:15.960268 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:15.960914 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:15.967256 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:15.967733 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:15.968166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:15.968893 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:15.969345 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:15.969770 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:16.098146 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:16.107120 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-cbe66c60-08e9-4c26-96eb-2c92a0a2a4c1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.150626 Oct 23 00:28:16.107900 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 607/1242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:15 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:17.130285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:17.130924 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:17.138498 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:17.138972 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:17.139403 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:17.140083 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:17.140560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:17.140983 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:17.275866 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:17.283575 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4bd44289-e7b5-4deb-a84c-4b3f0fd1357a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.157447 Oct 23 00:28:17.284142 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 636/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:17 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:18.306725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:18.307346 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:18.309508 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:18.314854 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:18.315342 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:18.315781 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:18.316505 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:18.316968 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:18.317398 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:18.446065 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:18.453717 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-84b26d53-21f7-4df0-aedb-e2a73527f505 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.150925 Oct 23 00:28:18.454278 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 608/1244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:18 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:19.477179 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:19.477779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:19.479702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:19.480474 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=6 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:28:19.486413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:19.486889 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:19.487329 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:19.488009 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:19.488452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:19.488897 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:19.623060 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:19.631012 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-14e87de9-7f6d-4eb2-a741-7839229a093c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.158214 Oct 23 00:28:19.632228 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 637/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:19 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:20.654240 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:20.654891 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:20.661282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:20.661758 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:20.662193 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:20.663492 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:20.663944 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:20.664368 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:20.798516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:20.806711 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-23641eaa-bbfe-4785-9461-53932dae6b27 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.156292 Oct 23 00:28:20.807286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 609/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:20 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:21.173794 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5991ee69-5845-432d-945f-204e01638abd", "name": "network-vif-plugged", "status": "completed", "tag": "44847aed-604d-471c-8c3b-0db333afaeb3"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:28:21.183704 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:21.184171 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:21.184652 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:21.196513 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] Creating event network-vif-plugged:44847aed-604d-471c-8c3b-0db333afaeb3 for instance 5991ee69-5845-432d-945f-204e01638abd on hv-cinder-86156 Oct 23 00:28:21.201522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-415354b3-b9a3-4838-97e2-8d3575d60eb6 req-58e96863-bd47-4cb7-af1e-bf786f7e645e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118556 Oct 23 00:28:21.202163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 638/1247] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:28:21.829785 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:21.830407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:21.836995 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:21.837478 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:21.837917 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:21.838612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:21.839072 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:21.839503 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:21.969485 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:21.977953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-7dede18f-aa5f-461b-9aa8-3eba473aef95 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1266 microversion: 2.1 time: 0.152038 Oct 23 00:28:21.978516 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 610/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:21 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:23.002377 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:23.003089 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:23.009671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:23.010144 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:23.010574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:23.011337 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:23.011786 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:23.012204 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:23.149035 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:23.156823 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-f54d6fd0-839b-44c9-b202-b5e5b79e9616 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1453 microversion: 2.1 time: 0.159164 Oct 23 00:28:23.157391 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 639/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:22 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:23.178670 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:28:23.179441 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:28:23.185638 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:23.186110 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:23.186537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:23.187215 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:23.187666 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:23.188087 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:23.317899 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:28:23.326105 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-b17599f6-614b-463e-acb3-618a81932fe7 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1453 microversion: 2.1 time: 0.151290 Oct 23 00:28:23.326664 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 611/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:28:23 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:28:24.954886 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5991ee69-5845-432d-945f-204e01638abd", "tag": "44847aed-604d-471c-8c3b-0db333afaeb3"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:28:24.965300 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:28:24.965779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:28:24.966215 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:28:24.977036 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] Creating event network-changed:44847aed-604d-471c-8c3b-0db333afaeb3 for instance 5991ee69-5845-432d-945f-204e01638abd on hv-cinder-86156 Oct 23 00:28:24.982453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-3f574231-7bdf-4eee-a9a5-8d46b3cc97b4 req-2b9bc613-1535-40f6-b22a-ff3fb7dd6976 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086296 Oct 23 00:28:24.983125 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 640/1251] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:30:23.998594 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c58e4d9e-3b07-4396-9e26-fb2d6fc2b898] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 00:30:23.999152 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:23.999886 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:24.004947 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-687127099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780540565", "security_groups": [{"name": "tempest-secgroup-smoke-1263401825"}], "block_device_mapping_v2": [{"uuid": "e95680d7-7e10-48c1-9a85-fff999eb5c77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde9904c-121b-4d23-a88a-fba69ead19b2"}]}} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:30:24.176407 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.network.neutron [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] validate_networks() for [('cde9904c-121b-4d23-a88a-fba69ead19b2', None, None, None, None, None)] {{(pid=118854) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 00:30:24.586694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 00:30:24.587117 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image limits 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 00:30:24.587639 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Flavor pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 00:30:24.588045 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Image pref 0:0:0 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 00:30:24.588471 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.virt.hardware [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 00:30:24.597376 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:24.597847 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:24.598275 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:24.598992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:24.599442 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:24.599864 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:24.616679 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 00:30:24.620574 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.quota [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Getting quotas for user 163f3d7a305f4d8b8eb14794a51acda4 and project 4a4117126a8d4004a3878e10554b0d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 00:30:24.677191 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Going to run 1 instances... {{(pid=118854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 00:30:24.679418 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e95680d7-7e10-48c1-9a85-fff999eb5c77',volume_size=None,volume_type=None)] {{(pid=118854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 00:30:24.808259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-3faed4c0-ddeb-4eb2-8b7a-8587cc7f25d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811702 Oct 23 00:30:24.809635 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 612/1252] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 00:30:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 00:30:24.819195 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b384acbd-fac2-4158-8a98-32c742125c3c] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 00:30:24.819809 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:24.820712 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=64 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:24.821346 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:30:24.821498 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 (ip 10.222.0.13) !!! Oct 23 00:30:24.828758 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-4311c691-5e60-4f9b-9803-095940c5f7fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:24.829469 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-4311c691-5e60-4f9b-9803-095940c5f7fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:24.938374 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-4311c691-5e60-4f9b-9803-095940c5f7fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:24.947966 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-4311c691-5e60-4f9b-9803-095940c5f7fc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1094 microversion: 2.1 time: 0.130715 Oct 23 00:30:24.948720 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 641/1253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:24 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:25.972792 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:25.973396 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:25.982241 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] [c58e4d9e-3b07-4396-9e26-fb2d6fc2b898] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34262. Oct 23 00:30:25.989266 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:25.989755 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:25.990186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:25.991068 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:25.991540 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:25.991943 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:26.054272 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:26.062140 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-be2ab46e-1900-45c2-8748-05147fe3c26b tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1210 microversion: 2.1 time: 0.094794 Oct 23 00:30:26.062714 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 613/1254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:25 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:27.085418 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:27.086020 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:27.094364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:27.094848 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:27.095282 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:27.095976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:27.096430 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:27.096875 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:27.103955 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] [b384acbd-fac2-4158-8a98-32c742125c3c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34266. Oct 23 00:30:27.242174 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:27.249865 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-24d55b13-0c8f-454f-a8c1-680a017e80ee tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.168346 Oct 23 00:30:27.250442 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 642/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:27 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:27.508421 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba75e8-8873-41eb-8571-0e508be0f3b9", "tag": "4e3c51c1-2548-4540-864d-e054f4bf24fa"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:30:27.518798 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:27.519355 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:27.519856 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:27.531954 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] Creating event network-changed:4e3c51c1-2548-4540-864d-e054f4bf24fa for instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 on hv-cinder-86156 Oct 23 00:30:27.535365 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR oslo.messaging._drivers.impl_rabbit [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] [565887df-2a43-4395-a4f8-73ced3bde04e] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 00:30:28.273680 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:28.274297 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:28.280852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:28.281334 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:28.281768 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:28.282455 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:28.282906 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:28.283332 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:28.410721 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:28.418277 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-43c96af2-2d94-457c-a3fd-64e4f6aff8a3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.148504 Oct 23 00:30:28.418838 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 643/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:28 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:30:28.542221 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] [565887df-2a43-4395-a4f8-73ced3bde04e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34274. Oct 23 00:30:28.547288 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-3a842677-3e7d-42c3-940f-b1f443ed2c88 req-0b8e59ae-7e8d-49c7-a115-c1fd59b60312 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.109834 Oct 23 00:30:28.547909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 614/1257] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 00:30:29.441307 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:29.441858 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:29.448147 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:29.448651 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:29.449081 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:29.449755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:29.450198 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:29.451227 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:29.584325 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:29.592569 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e706ac10-ae16-4b22-b4e7-3b2558d4f707 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.155159 Oct 23 00:30:29.593135 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 644/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:29 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:30.616166 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:30.616881 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:30.623837 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:30.624310 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:30.624768 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:30.625449 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:30.625898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:30.626316 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:30.756741 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:30.764849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-5cab16b9-e268-4382-8e33-5cbbdb7527ef tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.153314 Oct 23 00:30:30.765412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 615/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:30 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:31.787673 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:31.788293 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:31.794758 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:31.795189 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:31.795638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:31.796326 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:31.796804 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:31.797229 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:31.932995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:31.940655 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-39d8e776-6b42-4482-bea4-7fff4db6518e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.156885 Oct 23 00:30:31.941226 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 645/1260] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:31 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:32.963559 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:32.964144 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:32.970693 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:32.971169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:32.971600 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:32.972274 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:32.972746 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:32.973167 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:33.103412 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:33.111849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-94ba42b2-d733-443e-966c-b0e4ffd4a965 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.152173 Oct 23 00:30:33.112424 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 616/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:32 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:34.135364 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:34.135996 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:34.143139 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:34.143611 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:34.144040 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:34.144740 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:34.145186 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:34.145601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:34.275061 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:34.282881 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-fdac051a-f20f-4414-b1a6-de1b8f9c2f01 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.151587 Oct 23 00:30:34.283440 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 646/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:34 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 00:30:35.306650 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:35.307177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:35.309575 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=2 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:35.310225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell0:SELECT=6 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:35.316750 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:35.317225 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:35.317652 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:35.318332 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:35.318783 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:35.319197 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:35.455286 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:35.462882 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-23653912-70e2-4864-ae0d-39c01708865f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.160145 Oct 23 00:30:35.463444 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 617/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:35 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:36.486979 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:36.487522 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:36.489432 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell0:SELECT=2 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:30:36.495082 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:36.495560 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:36.495993 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:36.496702 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:36.497148 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:36.497564 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:36.631276 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:36.639713 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-e8ced8a6-aac4-4245-897f-6a7fafdca4ac tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.157202 Oct 23 00:30:36.640438 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 647/1264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:36 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:37.663377 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:37.663992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:37.671338 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:37.672025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:37.672536 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:37.673246 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:37.673703 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:37.674153 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:37.809932 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:37.817793 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-bb6bb5a0-0ee8-460c-b0d4-0b8fb00b0e6d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.158420 Oct 23 00:30:37.818359 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 618/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:37 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:38.840041 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:38.840687 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:38.848006 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:38.848533 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:38.848976 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:38.849671 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:38.850123 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:38.850542 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:38.978661 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:38.986601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2947e768-52d1-4931-aa9f-cd6b7c37835d tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.150501 Oct 23 00:30:38.987165 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 648/1266] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:38 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:39.618305 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba75e8-8873-41eb-8571-0e508be0f3b9", "name": "network-vif-plugged", "status": "completed", "tag": "4e3c51c1-2548-4540-864d-e054f4bf24fa"}]} {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:30:39.630636 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:39.631169 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:39.631598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:39.643695 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.compute.server_external_events [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] Creating event network-vif-plugged:4e3c51c1-2548-4540-864d-e054f4bf24fa for instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 on hv-cinder-86156 Oct 23 00:30:39.649001 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [req-2fc53a8a-6290-45fc-86a7-c78c424ed539 req-4bcc5193-c3d1-470b-a47e-9e82c96fcfc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034411 Oct 23 00:30:39.649598 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 619/1267] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:30:40.009565 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:40.010180 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:40.017367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:40.017856 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:40.018298 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:40.018989 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:40.019446 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:40.019872 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:40.147791 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:40.155672 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-2e4fa476-d285-4f2f-bbd5-6abdfb6e963f tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.150151 Oct 23 00:30:40.156389 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 649/1268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:40 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:41.178988 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:41.179589 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:41.186960 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:41.187653 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:41.188106 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:41.188849 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:41.189304 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:41.189725 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:41.322427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:41.330235 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f5093262-19d3-44f2-b4a6-9a7d7bdd1a25 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1266 microversion: 2.1 time: 0.155691 Oct 23 00:30:41.330799 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 620/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:41 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:42.353076 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:42.353696 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:42.360098 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:42.360617 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:42.361106 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:42.361752 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:42.362209 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:42.362638 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:42.492453 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:42.500801 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-8ea62e90-4a00-46e7-97a2-419024f033c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1453 microversion: 2.1 time: 0.151548 Oct 23 00:30:42.501367 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 650/1270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:42 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:42.523088 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:30:42.523701 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:30:42.530022 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:42.530521 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:42.530977 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:42.531642 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:42.532100 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:42.532542 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:42.902644 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:30:42.911253 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-e905ac01-213e-4d71-b806-2591247a73cd tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1453 microversion: 2.1 time: 0.392119 Oct 23 00:30:42.911829 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 621/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:30:42 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1453 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:30:44.478574 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba75e8-8873-41eb-8571-0e508be0f3b9", "tag": "4e3c51c1-2548-4540-864d-e054f4bf24fa"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:30:44.488248 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:30:44.488861 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:30:44.489357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:30:44.500697 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] Creating event network-changed:4e3c51c1-2548-4540-864d-e054f4bf24fa for instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 on hv-cinder-86156 Oct 23 00:30:44.505738 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-1e88fcc9-6739-48ce-b6d9-a8082b767c98 req-54bb4ba5-27c8-416e-8fb9-40bf868aad6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030928 Oct 23 00:30:44.506544 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 651/1272] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:32:34.193898 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:34.197545 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b384acbd-fac2-4158-8a98-32c742125c3c] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 00:32:34.198684 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_api:SELECT=24 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:32:34.199413 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG dbcounter [-] [118855] Writing DB stats nova_cell1:SELECT=56 {{(pid=118855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:32:34.200868 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:32:34.201023 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Sun Oct 23 00:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 23 00:32:34.202512 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:34.205374 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:32:34.211049 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba75e8-8873-41eb-8571-0e508be0f3b9", "tag": "4e3c51c1-2548-4540-864d-e054f4bf24fa"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:32:34.217351 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG dbcounter [-] [118854] Writing DB stats nova_cell1:SELECT=48 {{(pid=118854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:32:34.218831 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 00:32:34.219186 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Sun Oct 23 00:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 (ip 10.222.0.13) !!! Oct 23 00:32:34.220401 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 00:32:34.220757 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Sun Oct 23 00:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 (ip 10.222.0.13) !!! Oct 23 00:32:34.229981 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:34.235025 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:34.235696 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:34.236419 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:34.236909 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:34.237344 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:34.243860 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:34.244336 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:34.244787 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:34.258709 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] Creating event network-changed:4e3c51c1-2548-4540-864d-e054f4bf24fa for instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 on hv-cinder-86156 Oct 23 00:32:34.263975 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-cb2c8126-2c63-4446-8af7-a6b6c2c4bd22 req-6939444f-62ef-4fbb-a7b1-e9cc862b81cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068140 Oct 23 00:32:34.264777 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 652/1273] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:32:34.275719 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:32:34.358596 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-6b891f9c-6835-4922-a512-0746b3eaf64e tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 204 len: 0 microversion: 2.1 time: 0.169928 Oct 23 00:32:34.362236 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 622/1274] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:32:34 2022] DELETE /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:32:34.368855 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:34.369885 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:34.376813 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:34.377303 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:34.377736 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:34.378682 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:34.379132 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:34.379779 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:34.526356 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:34.534119 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-cc436dc9-b4bc-41b2-b54a-02ef8bf673d3 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1577 microversion: 2.1 time: 0.170146 Oct 23 00:32:34.534701 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 653/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:34 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:35.558537 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:35.559230 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:35.565953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:35.566427 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:35.566865 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:35.567548 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:35.568061 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:35.568601 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:35.705055 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:35.713333 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f7446a8f-8d6b-410c-93c5-47fe3cfff203 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1577 microversion: 2.1 time: 0.159050 Oct 23 00:32:35.713906 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 623/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:35 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:36.475127 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba75e8-8873-41eb-8571-0e508be0f3b9", "name": "network-vif-deleted", "tag": "4e3c51c1-2548-4540-864d-e054f4bf24fa"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:32:36.490827 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO oslo.messaging._drivers.impl_rabbit [-] [b384acbd-fac2-4158-8a98-32c742125c3c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34362. Oct 23 00:32:36.497343 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:36.497911 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:36.498755 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:36.511601 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] Creating event network-vif-deleted:4e3c51c1-2548-4540-864d-e054f4bf24fa for instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 on hv-cinder-86156 Oct 23 00:32:36.517051 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-57c8214a-576d-4f1d-ba5e-91d69cf5f1ba req-4de3fb43-947c-49e1-af7d-c0d6c1d8857c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045806 Oct 23 00:32:36.517862 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 654/1277] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:32:36.736199 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:36.737517 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:36.744647 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:36.745393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:36.745832 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:36.747121 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:36.747759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:36.748190 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:36.823739 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:36.832934 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-0d742378-a726-4973-8444-1ed60e4d44cc tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 200 len: 1225 microversion: 2.1 time: 0.100471 Oct 23 00:32:36.833533 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 624/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:36 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:37.856108 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:37.856841 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 58ba75e8-8873-41eb-8571-0e508be0f3b9] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:37.863527 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:37.864010 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:37.864448 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:37.865163 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:37.865642 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:37.866066 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:37.879546 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] HTTP exception thrown: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Request method failure captured: Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 HTTP/1.1 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIndI7FknKa3b3PdeX2XAeDDuNyw2DjABfJrjysQJV7upLRtOQ6HPhDJMGWs0No54StZMcrTHC_8ICj8Ck6HcgUliXcmSycL5vEHgTb0Xy2lciLHGgjPcPBsVEN6B9PZkZwbBXRUrBgpzi34YXzUmWR_gesNFpnjgVr0bGT9DWht3y8 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:32:37.882099 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a4117126a8d4004a3878e10554b0d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 163f3d7a305f4d8b8eb14794a51acda4 Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. Oct 23 00:32:37.883956 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '58ba75e8-8873-41eb-8571-0e508be0f3b9'} Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:32:37.885016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. Oct 23 00:32:37.886751 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:37.888646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Returning 404 to user: Instance 58ba75e8-8873-41eb-8571-0e508be0f3b9 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:32:37.888646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-974cc0fd-b484-418d-a3fc-4ba1cbbc67c2 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9" status: 404 len: 111 microversion: 2.1 time: 0.031620 Oct 23 00:32:37.888646 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 655/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:37 2022] GET /compute/v2.1/servers/58ba75e8-8873-41eb-8571-0e508be0f3b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:32:41.171322 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:41.171868 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:41.173424 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5991ee69-5845-432d-945f-204e01638abd", "tag": "44847aed-604d-471c-8c3b-0db333afaeb3"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:32:41.179596 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:41.180327 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:41.180790 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:41.181487 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:41.182150 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:41.182573 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:41.185085 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:41.185688 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:41.186121 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:41.200133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] Creating event network-changed:44847aed-604d-471c-8c3b-0db333afaeb3 for instance 5991ee69-5845-432d-945f-204e01638abd on hv-cinder-86156 Oct 23 00:32:41.205156 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-3c289672-8ad4-4328-aa7e-527dbc07d5af req-679463b6-e3a9-4302-84d5-3a60014dd8c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035407 Oct 23 00:32:41.205995 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 656/1280] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:32:41.208633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Going to try to terminate instance {{(pid=118854) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 00:32:41.302312 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-47b06880-9879-46b1-879c-7d34ac78987a tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 204 len: 0 microversion: 2.1 time: 0.134195 Oct 23 00:32:41.303782 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 625/1281] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:32:41 2022] DELETE /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 00:32:41.313045 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:41.313745 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:41.319919 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:41.320405 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:41.320874 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:41.321896 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:41.322556 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:41.322987 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:41.477825 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.policy [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118855) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:41.485824 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-7ec53e76-4665-41c6-a63f-dcecd7ff2758 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1578 microversion: 2.1 time: 0.177213 Oct 23 00:32:41.486397 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 657/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:41 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:42.510738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:42.511486 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:42.519612 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:42.520108 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:42.520571 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:42.521296 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:42.521730 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:42.522953 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:42.656258 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:42.664694 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-ec597c56-997e-48e2-aac1-0bdb4905c92c tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1578 microversion: 2.1 time: 0.158154 Oct 23 00:32:42.665662 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 626/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:42 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:43.343285 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5991ee69-5845-432d-945f-204e01638abd", "name": "network-vif-deleted", "tag": "44847aed-604d-471c-8c3b-0db333afaeb3"}]} {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 00:32:43.354219 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:43.354698 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:43.355129 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:43.366826 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.compute.server_external_events [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] Creating event network-vif-deleted:44847aed-604d-471c-8c3b-0db333afaeb3 for instance 5991ee69-5845-432d-945f-204e01638abd on hv-cinder-86156 Oct 23 00:32:43.371639 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [req-e86a980d-5cb8-482b-b306-056cb79ce7ad req-58cd6221-f896-4417-90e6-725aa47d1e8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Oct 23 00:32:43.372237 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 658/1284] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 00:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:32:43.689456 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:43.689922 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:43.696455 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:43.696992 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:43.697437 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:43.698143 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:43.698633 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:43.699063 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:43.733195 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:43.733686 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:43.734129 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:43.734577 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.objects.instance [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lazy-loading 'fault' on Instance uuid 5991ee69-5845-432d-945f-204e01638abd {{(pid=118854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 00:32:43.777020 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.policy [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163f3d7a305f4d8b8eb14794a51acda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4117126a8d4004a3878e10554b0d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118854) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 00:32:43.784833 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-c102b207-2dab-4a88-8872-ee8f466afda1 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 200 len: 1230 microversion: 2.1 time: 0.099575 Oct 23 00:32:43.785393 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 627/1285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:43 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 00:32:44.809543 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:44.810237 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 5991ee69-5845-432d-945f-204e01638abd] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:44.816387 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:44.816894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:44.817357 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:44.818034 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:44.818481 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:44.819018 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:44.832016 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] HTTP exception thrown: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Request method failure captured: Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd HTTP/1.1 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIndI7FknKa3b3PdeX2XAeDDuNyw2DjABfJrjysQJV7upLRtOQ6HPhDJMGWs0No54StZMcrTHC_8ICj8Ck6HcgUliXcmSycL5vEHgTb0Xy2lciLHGgjPcPBsVEN6B9PZkZwbBXRUrBgpzi34YXzUmWR_gesNFpnjgVr0bGT9DWht3y8 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:32:44.833637 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a4117126a8d4004a3878e10554b0d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 163f3d7a305f4d8b8eb14794a51acda4 Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. Oct 23 00:32:44.835859 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '5991ee69-5845-432d-945f-204e01638abd'} Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:32:44.836817 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. Oct 23 00:32:44.838452 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:44.839894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Returning 404 to user: Instance 5991ee69-5845-432d-945f-204e01638abd could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:32:44.839894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-0fe9088f-616d-457c-ab80-cb40b5fd47ea tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd" status: 404 len: 111 microversion: 2.1 time: 0.030450 Oct 23 00:32:44.839894 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 659/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:44 2022] GET /compute/v2.1/servers/5991ee69-5845-432d-945f-204e01638abd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:32:45.276234 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:45.276794 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.compute.api [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118854) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:45.283259 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:45.283738 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:45.284177 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:45.284902 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:45.285362 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:45.285789 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG oslo_concurrency.lockutils [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:45.299354 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.wsgi [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] HTTP exception thrown: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Request method failure captured: Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: request: DELETE /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 HTTP/1.1 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept: application/json Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Accept-Encoding: identity Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Connection: close Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Length: 0 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Content-Type: application/json Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Host: 10.222.0.13 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: Openstack-System-Scope: None Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: User-Agent: python-urllib3/1.26.12 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Auth-Token: gAAAAABjVIndI7FknKa3b3PdeX2XAeDDuNyw2DjABfJrjysQJV7upLRtOQ6HPhDJMGWs0No54StZMcrTHC_8ICj8Ck6HcgUliXcmSycL5vEHgTb0Xy2lciLHGgjPcPBsVEN6B9PZkZwbBXRUrBgpzi34YXzUmWR_gesNFpnjgVr0bGT9DWht3y8 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Id: None Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Domain-Name: None Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Identity-Status: Confirmed Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Is-Admin-Project: True Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Id: default Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Domain-Name: Default Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Project-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Role: member,reader Oct 23 00:32:45.301085 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Roles: member,reader Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a4117126a8d4004a3878e10554b0d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-Tenant-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Id: default Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Domain-Name: Default Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Id: 163f3d7a305f4d8b8eb14794a51acda4 Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: X-User-Name: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: method: > Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: exception: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.302931 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: action_args: {'id': '968e3fb4-17cf-4214-acea-bd0036628e71'} Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:32:45.304282 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.305928 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.307544 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Returning 404 to user: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. {{(pid=118854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:32:45.307544 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-f81672e7-6de2-41a8-a408-1ccee78db492 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 404 len: 111 microversion: 2.1 time: 0.030776 Oct 23 00:32:45.307544 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 628/1287] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 00:32:45 2022] DELETE /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:32:45.311736 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '>' {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:45.312344 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.compute.api [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] [instance: 968e3fb4-17cf-4214-acea-bd0036628e71] Fetching instance by UUID {{(pid=118855) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 00:32:45.318375 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:45.319366 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:45.319863 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:45.320596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Acquiring lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:32:45.321052 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:32:45.321470 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG oslo_concurrency.lockutils [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Lock "0d6b50a2-1ab7-40d4-8932-c4ce65dcaf06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:32:45.335199 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.wsgi [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] HTTP exception thrown: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Request method failure captured: Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: request: GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 HTTP/1.1 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept: application/json Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Accept-Encoding: identity Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Connection: close Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Length: 0 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Content-Type: application/json Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Host: 10.222.0.13 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: Openstack-System-Scope: None Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: User-Agent: python-urllib3/1.26.12 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Auth-Token: gAAAAABjVIndI7FknKa3b3PdeX2XAeDDuNyw2DjABfJrjysQJV7upLRtOQ6HPhDJMGWs0No54StZMcrTHC_8ICj8Ck6HcgUliXcmSycL5vEHgTb0Xy2lciLHGgjPcPBsVEN6B9PZkZwbBXRUrBgpzi34YXzUmWR_gesNFpnjgVr0bGT9DWht3y8 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Id: None Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Domain-Name: None Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Identity-Status: Confirmed Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Is-Admin-Project: True Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Id: default Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Domain-Name: Default Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Project-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Role: member,reader Oct 23 00:32:45.336852 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Roles: member,reader Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a4117126a8d4004a3878e10554b0d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a4117126a8d4004a3878e10554b0d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Id: 4a4117126a8d4004a3878e10554b0d5c Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-Tenant-Name: tempest-TestVolumeBootPattern-1583034823 Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Id: default Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Domain-Name: Default Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Id: 163f3d7a305f4d8b8eb14794a51acda4 Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: X-User-Name: tempest-TestVolumeBootPattern-1583034823-project Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: method: > Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: exception: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.338596 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: action_args: {'id': '968e3fb4-17cf-4214-acea-bd0036628e71'} Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: {{(pid=118855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 00:32:45.339445 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. Oct 23 00:32:45.340904 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: ERROR nova.api.openstack.wsgi Oct 23 00:32:45.342133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: DEBUG nova.api.openstack.wsgi [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Returning 404 to user: Instance 968e3fb4-17cf-4214-acea-bd0036628e71 could not be found. {{(pid=118855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 00:32:45.342133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: INFO nova.api.openstack.requestlog [None req-26e7afc4-331c-459a-bc6c-720b9f957ee9 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71" status: 404 len: 111 microversion: 2.1 time: 0.030344 Oct 23 00:32:45.342133 dv-cinder-861566-5-iscsi devstack@n-api.service[118855]: [pid: 118855|app: 0|req: 660/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 00:32:45 2022] GET /compute/v2.1/servers/968e3fb4-17cf-4214-acea-bd0036628e71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 00:32:46.631720 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: DEBUG nova.api.openstack.wsgi [None req-85746546-22d0-4ad5-996f-45e8b6f9ee12 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] Calling method '.version_select at 0x7f3f8d9761f0>' {{(pid=118854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:32:46.660810 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: INFO nova.api.openstack.requestlog [None req-85746546-22d0-4ad5-996f-45e8b6f9ee12 tempest-TestVolumeBootPattern-1583034823 tempest-TestVolumeBootPattern-1583034823-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1780540565" status: 202 len: 0 microversion: 2.1 time: 0.032824 Oct 23 00:32:46.666759 dv-cinder-861566-5-iscsi devstack@n-api.service[118854]: [pid: 118854|app: 0|req: 629/1289] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 23 00:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1780540565 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)